-- Logs begin at Fri 2021-08-27 01:33:16 UTC, end at Fri 2021-08-27 05:15:05 UTC. -- Aug 27 02:17:18.413235 n-d-802225-4 systemd[1]: Started Devstack devstack@n-super-cond.service. Aug 27 02:17:22.037070 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_db.sqlalchemy.engines [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:17:22.107641 n-d-802225-4 nova-conductor[100639]: DEBUG nova.context [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) {{(pid=100639) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:17:22.111342 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_concurrency.lockutils [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:17:22.112880 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_concurrency.lockutils [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:17:22.113764 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_concurrency.lockutils [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:17:22.115597 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_concurrency.lockutils [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:17:22.129596 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_db.sqlalchemy.engines [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:17:22.130813 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_db.sqlalchemy.engines [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:17:22.454636 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_concurrency.lockutils [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Acquired lock "singleton_lock" {{(pid=100639) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 02:17:22.455133 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_concurrency.lockutils [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Releasing lock "singleton_lock" {{(pid=100639) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 02:17:22.455846 n-d-802225-4 nova-conductor[100639]: INFO oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Starting 2 workers Aug 27 02:17:22.460557 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Started child 101511 {{(pid=100639) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Aug 27 02:17:22.465694 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Started child 101512 {{(pid=100639) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Aug 27 02:17:22.466806 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Full set of CONF: {{(pid=100639) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Aug 27 02:17:22.467207 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ******************************************************************************** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:17:22.467545 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] Configuration options gathered from: {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:17:22.467938 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:17:22.468296 n-d-802225-4 nova-conductor[101511]: INFO nova.service [-] Starting conductor node (version 23.1.0) Aug 27 02:17:22.468794 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] config files: ['/etc/nova/nova.conf'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:17:22.468892 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ================================================================================ {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:17:22.469648 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] allow_resize_to_same_host = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.470103 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] arq_binding_timeout = 300 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.470535 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] block_device_allocate_retries = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.470968 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] block_device_allocate_retries_interval = 3 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.471429 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cert = self.pem {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.471857 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute_driver = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.472332 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute_monitors = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.472829 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] config_dir = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.473286 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] config_drive_format = iso9660 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.480440 n-d-802225-4 nova-conductor[101512]: INFO nova.service [-] Starting conductor node (version 23.1.0) Aug 27 02:17:22.485791 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.486310 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] config_source = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.486802 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] console_host = n-d-802225-4 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.487395 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] control_exchange = nova {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.487973 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cpu_allocation_ratio = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.488514 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] daemon = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.489078 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] debug = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.489659 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] default_access_ip_network_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.490231 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] default_availability_zone = nova {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.490752 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] default_ephemeral_format = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.491616 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.491777 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_db.sqlalchemy.engines [None req-60ad09db-a8cf-484c-842b-8445dc3b2da3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:17:22.493828 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] default_schedule_zone = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.494651 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] disk_allocation_ratio = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.495481 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] enable_new_services = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.496436 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] enabled_apis = ['osapi_compute'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.497244 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] enabled_ssl_apis = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.498118 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] flat_injected = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.498770 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] force_config_drive = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.499296 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] force_raw_images = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.499869 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] graceful_shutdown_timeout = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.501206 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] heal_instance_info_cache_interval = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.502143 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] host = n-d-802225-4 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.503931 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.504488 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] initial_disk_allocation_ratio = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.509632 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] initial_ram_allocation_ratio = 1.5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.510385 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.510915 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] instance_build_timeout = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.511429 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] instance_delete_interval = 300 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.512529 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] instance_format = [instance: %(uuid)s] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.513058 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] instance_name_template = instance-%08x {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.513618 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] instance_usage_audit = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.514177 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] instance_usage_audit_period = month {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.514693 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.516682 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] instances_path = /opt/stack/data/nova/instances {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.517211 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] internal_service_availability_zone = internal {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.523835 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_db.sqlalchemy.engines [None req-d2579b38-9111-4b98-821a-2ba15f363721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:17:22.533952 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] key = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.534420 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] live_migration_retry_count = 30 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.534858 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] log_config_append = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.535283 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.535676 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] log_dir = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.536076 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] log_file = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.536402 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] log_options = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.536806 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] log_rotate_interval = 1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.537386 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] log_rotate_interval_type = days {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.537987 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] log_rotation_type = none {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.538459 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.538924 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.539475 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.540060 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.540526 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.541100 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] long_rpc_timeout = 1800 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.541665 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] max_concurrent_builds = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.542199 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] max_concurrent_live_migrations = 1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.542859 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] max_concurrent_snapshots = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.543393 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] max_local_block_devices = 3 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.543918 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] max_logfile_count = 30 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.544444 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] max_logfile_size_mb = 200 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.544971 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] maximum_instance_delete_attempts = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.545568 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] metadata_listen = 0.0.0.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.546136 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] metadata_listen_port = 8775 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555289 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] metadata_workers = 2 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555289 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] migrate_max_retries = -1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555289 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] mkisofs_cmd = genisoimage {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555289 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] my_block_storage_ip = 10.222.0.20 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555289 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] my_ip = 10.222.0.20 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555289 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] network_allocate_retries = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555770 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555770 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] osapi_compute_listen = 0.0.0.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555770 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] osapi_compute_listen_port = 8774 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555770 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] osapi_compute_unique_server_name_scope = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555770 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] osapi_compute_workers = 2 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555770 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] password_length = 12 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.555770 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] periodic_enable = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.556227 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] periodic_fuzzy_delay = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.556227 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] pointer_model = usbtablet {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.556227 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] preallocate_images = none {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.556227 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] publish_errors = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.556227 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] pybasedir = /opt/stack/nova {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.556227 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ram_allocation_ratio = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.556227 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] rate_limit_burst = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.556666 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] rate_limit_except_level = CRITICAL {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.556894 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] rate_limit_interval = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.557532 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] reboot_timeout = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.558144 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] reclaim_instance_interval = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.558777 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] record = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.559407 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] report_interval = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.560036 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] rescue_timeout = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.560642 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] reserved_host_cpus = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.561256 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] reserved_host_disk_mb = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.561909 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] reserved_host_memory_mb = 512 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.562527 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] reserved_huge_pages = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.563142 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] resize_confirm_window = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.563764 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] resize_fs_using_block_device = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.564377 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] resume_guests_state_on_host_boot = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.565037 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.565679 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] rpc_response_timeout = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.566270 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] run_external_periodic_tasks = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.566873 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] running_deleted_instance_action = reap {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.567506 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] running_deleted_instance_poll_interval = 1800 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.568092 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] running_deleted_instance_timeout = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.568684 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler_instance_sync_interval = 120 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.569278 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_down_time = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.569914 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] servicegroup_driver = db {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.570515 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] shelved_offload_time = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.571107 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] shelved_poll_interval = 3600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.571679 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] shutdown_timeout = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.572281 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] source_is_ipv6 = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.572889 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ssl_only = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.573662 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] state_path = /opt/stack/data/nova {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.574798 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] sync_power_state_interval = 600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.575402 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] sync_power_state_pool_size = 1000 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.576027 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] syslog_log_facility = LOG_USER {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.576620 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] tempdir = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.577206 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] timeout_nbd = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.577847 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] transport_url = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.578463 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] update_resources_interval = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.579065 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] use_cow_images = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.579661 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] use_eventlog = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.580270 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] use_journal = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.580873 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] use_json = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.581488 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] use_rootwrap_daemon = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.582089 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] use_stderr = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.582709 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] use_syslog = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.583304 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vcpu_pin_set = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.583913 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vif_plugging_is_fatal = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.584503 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vif_plugging_timeout = 300 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.585122 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] virt_mkfs = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.585758 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] volume_usage_poll_interval = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.586357 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] watch_log_file = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.586967 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] web = /usr/share/spice-html5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:17:22.587709 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_concurrency.disable_process_locking = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.588492 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.589356 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.590770 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.591588 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.592431 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.593034 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.593692 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.auth_strategy = keystone {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.594223 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.compute_link_prefix = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.594791 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600243 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.dhcp_domain = novalocal {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600243 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.enable_instance_password = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600243 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.glance_link_prefix = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600243 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600243 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600243 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.instance_list_per_project_cells = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600673 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.list_records_by_skipping_down_cells = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600673 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.local_metadata_per_cell = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600673 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.max_limit = 1000 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600673 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.metadata_cache_expiration = 15 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600673 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.neutron_default_tenant_id = default {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600673 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.use_forwarded_for = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.600673 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.use_neutron_default_nets = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.601086 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.601086 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.601086 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.601437 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.602133 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.vendordata_dynamic_targets = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.602672 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.vendordata_jsonfile_path = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.603222 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.603855 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.backend = dogpile.cache.memcached {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.604434 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.backend_argument = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.604972 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.config_prefix = cache.oslo {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.605562 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.debug_cache_backend = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.606115 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.enabled = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.606740 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.expiration_time = 600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.607264 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.memcache_dead_retry = 300 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.607794 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.608312 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.608849 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.memcache_pool_maxsize = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.609370 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.609930 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.610475 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.memcache_socket_timeout = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.611000 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.proxies = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.611528 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.tls_allowed_ciphers = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.612038 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.tls_cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.612552 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.tls_certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.613068 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.tls_enabled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.613622 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cache.tls_keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.614188 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.auth_section = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.614743 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.auth_type = password {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.615271 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.615843 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.catalog_info = volumev3::publicURL {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.616371 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.616906 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.617486 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.cross_az_attach = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.618026 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.endpoint_template = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.618542 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.http_retries = 3 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.619079 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.619593 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.620111 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.os_region_name = RegionOne {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.620643 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.621186 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cinder.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.621737 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.622282 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute.cpu_dedicated_set = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.622797 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute.cpu_shared_set = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.623315 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute.image_type_exclude_list = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.623842 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.623962 n-d-802225-4 nova-conductor[101511]: DEBUG nova.service [None req-60ad09db-a8cf-484c-842b-8445dc3b2da3 None None] Creating RPC server for service conductor {{(pid=101511) start /opt/stack/nova/nova/service.py:182}} Aug 27 02:17:22.624480 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute.max_concurrent_disk_ops = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.625014 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute.max_disk_devices_to_attach = -1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.625576 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.626103 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute.resource_provider_association_refresh = 300 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.628913 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] compute.shutdown_retry_interval = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.628913 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] conductor.workers = 2 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.628913 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] console.allowed_origins = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.628913 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] console.ssl_ciphers = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.628913 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] console.ssl_minimum_version = default {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.628913 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] consoleauth.token_ttl = 600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.629665 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.630221 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.630748 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.631523 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.connect_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.632066 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.connect_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.632584 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.endpoint_override = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.633121 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.633664 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.634194 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.max_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.634713 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.min_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.635270 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.region_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.635787 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.service_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.636335 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.service_type = accelerator {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.637367 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.637928 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.status_code_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.638443 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.status_code_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.638971 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.639566 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.640077 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] cyborg.version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.640635 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.backend = sqlalchemy {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.641212 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.connection = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.641780 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.connection_debug = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.642332 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.connection_parameters = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.642866 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.connection_recycle_time = 3600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.643415 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.connection_trace = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.643935 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.db_inc_retry_interval = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.644455 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.db_max_retries = 20 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.644984 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.db_max_retry_interval = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.645689 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.db_retry_interval = 1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.646361 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.max_overflow = 50 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.646962 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.max_pool_size = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.647497 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.max_retries = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.648080 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.mysql_enable_ndb = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.648624 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.649169 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.pool_timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.649731 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.retry_interval = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.650275 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.slave_connection = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.650799 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.sqlite_synchronous = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.651371 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] database.use_db_reconnect = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.651906 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.backend = sqlalchemy {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.652627 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.connection = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.653216 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.connection_debug = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.653815 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.connection_parameters = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.654346 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.connection_recycle_time = 3600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.654886 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.connection_trace = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.655462 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.db_inc_retry_interval = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.655926 n-d-802225-4 nova-conductor[101512]: DEBUG nova.service [None req-d2579b38-9111-4b98-821a-2ba15f363721 None None] Creating RPC server for service conductor {{(pid=101512) start /opt/stack/nova/nova/service.py:182}} Aug 27 02:17:22.656123 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.db_max_retries = 20 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.656645 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.db_max_retry_interval = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.657211 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.db_retry_interval = 1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.657793 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.max_overflow = 50 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.658361 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.max_pool_size = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.658895 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.max_retries = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.659418 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.mysql_enable_ndb = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.659956 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.660468 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.pool_timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.660992 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.retry_interval = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.661581 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.slave_connection = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.662101 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] api_database.sqlite_synchronous = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.662676 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] devices.enabled_mdev_types = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.663233 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.663746 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ephemeral_storage_encryption.enabled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.664272 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.664830 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.api_servers = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.665393 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.665963 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.666490 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.667029 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.connect_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.667542 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.connect_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.668597 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.debug = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.669179 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.default_trusted_certificate_ids = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.669802 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.enable_certificate_validation = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.670324 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.enable_rbd_download = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.670851 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.endpoint_override = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.671376 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.671907 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.672449 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.max_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.672966 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.min_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.673564 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.num_retries = 3 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.674093 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.rbd_ceph_conf = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.674700 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.rbd_connect_timeout = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.675255 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.rbd_pool = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.675782 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.rbd_user = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.676294 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.region_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.676809 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.service_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.677340 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.service_type = image {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.677874 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.678405 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.status_code_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.678915 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.status_code_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.679480 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.680042 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.680559 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.verify_glance_signatures = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.681083 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] glance.version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.681699 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] guestfs.debug = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.682332 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.config_drive_cdrom = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.682848 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.config_drive_inject_password = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.683390 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.684500 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.enable_instance_metrics_collection = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.685034 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.enable_remotefx = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.685608 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.instances_path_share = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.686127 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.iscsi_initiator_list = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.686660 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.limit_cpu_features = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.687190 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.687723 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.688237 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.power_state_check_timeframe = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.688749 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.689295 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.689877 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.use_multipath_io = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.690406 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.volume_attach_retry_count = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.690926 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.691433 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.vswitch_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.691984 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.692542 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] mks.enabled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.693773 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.694337 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] image_cache.manager_interval = 2400 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.694965 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] image_cache.precache_concurrency = 1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.695499 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] image_cache.remove_unused_base_images = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.696023 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.696571 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.697117 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] image_cache.subdirectory_name = _base {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.697751 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.api_max_retries = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.698355 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.api_retry_interval = 2 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.698936 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.auth_section = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.699521 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.auth_type = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.700076 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.700640 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.701198 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.701772 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.connect_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.702329 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.connect_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.702894 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.endpoint_override = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.703474 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.704026 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.704586 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.max_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.705184 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.min_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.705776 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.partition_key = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.706386 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.peer_list = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.706937 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.region_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.707523 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.serial_console_state_timeout = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.708068 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.service_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.708659 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.service_type = baremetal {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.709339 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.709905 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.status_code_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.710464 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.status_code_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.711045 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.711652 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.712243 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ironic.version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.712856 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.713514 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] key_manager.fixed_key = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.714191 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.715313 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.barbican_api_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.715916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.barbican_endpoint = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.716544 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.barbican_endpoint_type = public {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.717144 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.barbican_region_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.717762 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.718336 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.718916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.719507 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.720076 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.720690 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.number_of_retries = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.721284 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.retry_delay = 1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.721899 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.send_service_user_token = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.722511 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.723109 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.723688 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.verify_ssl = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.724266 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican.verify_ssl_path = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.724867 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican_service_user.auth_section = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.725441 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican_service_user.auth_type = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.726050 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican_service_user.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.726621 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican_service_user.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.727271 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican_service_user.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.727843 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican_service_user.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.728374 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican_service_user.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.728931 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican_service_user.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.729501 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] barbican_service_user.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.730065 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.approle_role_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.730685 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.approle_secret_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.731223 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.731756 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.743916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.743916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.743916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.743916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.kv_mountpoint = secret {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.743916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.kv_version = 2 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.743916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.root_token_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.743916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744389 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.ssl_ca_crt_file = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744389 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744389 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.use_ssl = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744389 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744389 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744389 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744389 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744803 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.connect_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744803 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.connect_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744803 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.endpoint_override = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744803 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744803 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744803 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.max_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.744803 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.min_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.745209 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.region_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.745209 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.service_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.745209 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.service_type = identity {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.745209 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.745209 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.status_code_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.745209 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.status_code_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.745209 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.745640 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.745640 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] keystone.version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.748525 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.connection_uri = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.751121 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.cpu_mode = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.753135 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.cpu_model_extra_flags = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.754960 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.cpu_models = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.755876 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.device_detach_attempts = 8 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.756749 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.device_detach_timeout = 20 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.756895 n-d-802225-4 nova-conductor[101511]: DEBUG nova.service [None req-60ad09db-a8cf-484c-842b-8445dc3b2da3 None None] Join ServiceGroup membership for this service conductor {{(pid=101511) start /opt/stack/nova/nova/service.py:199}} Aug 27 02:17:22.757484 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.disk_cachemodes = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.757748 n-d-802225-4 nova-conductor[101511]: DEBUG nova.servicegroup.drivers.db [None req-60ad09db-a8cf-484c-842b-8445dc3b2da3 None None] DB_Driver: join new ServiceGroup member n-d-802225-4 to the conductor group, service = {{(pid=101511) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Aug 27 02:17:22.758058 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.disk_prefix = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.758557 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.enabled_perf_events = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.759111 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.file_backed_memory = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.759600 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.gid_maps = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.760483 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.hw_disk_discard = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.760970 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.hw_machine_type = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.763111 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.images_rbd_ceph_conf = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.764048 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.765577 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.766605 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.images_rbd_glance_store_name = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.769904 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.images_rbd_pool = rbd {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.770391 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.images_type = default {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.770798 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.images_volume_group = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.771206 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.inject_key = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.771607 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.inject_partition = -2 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.772018 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.inject_password = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.772426 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.iscsi_iface = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.772823 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.iser_use_multipath = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.773215 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_bandwidth = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.773644 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.774033 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_downtime = 500 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.774423 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.774817 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.775682 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_inbound_addr = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.776172 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.776983 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_permit_post_copy = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.777582 n-d-802225-4 nova-conductor[101512]: DEBUG nova.service [None req-d2579b38-9111-4b98-821a-2ba15f363721 None None] Join ServiceGroup membership for this service conductor {{(pid=101512) start /opt/stack/nova/nova/service.py:199}} Aug 27 02:17:22.777723 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_scheme = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.778207 n-d-802225-4 nova-conductor[101512]: DEBUG nova.servicegroup.drivers.db [None req-d2579b38-9111-4b98-821a-2ba15f363721 None None] DB_Driver: join new ServiceGroup member n-d-802225-4 to the conductor group, service = {{(pid=101512) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Aug 27 02:17:22.778408 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_timeout_action = abort {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.779419 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_tunnelled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.779966 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_uri = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.780365 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.live_migration_with_native_tls = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.780781 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.max_queues = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.781177 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.781594 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.nfs_mount_options = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.782225 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.782622 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.783019 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.num_iser_scan_tries = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.783405 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.num_memory_encrypted_guests = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.783798 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.784191 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.num_pcie_ports = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.784590 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.num_volume_scan_tries = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.785037 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.pmem_namespaces = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.785421 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.quobyte_client_cfg = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.785948 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.786342 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.rbd_connect_timeout = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.786732 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.787120 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.787510 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.rbd_secret_uuid = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.787888 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.rbd_user = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.788280 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.788682 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.remote_filesystem_transport = ssh {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.789063 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.rescue_image_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.789443 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.rescue_kernel_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.789878 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.rescue_ramdisk_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.790276 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.790657 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.rx_queue_size = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.791052 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.smbfs_mount_options = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.791542 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.791929 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.snapshot_compression = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.792311 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.snapshot_image_format = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.792839 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.793236 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.sparse_logical_volumes = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.793649 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.swtpm_enabled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.794248 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.swtpm_group = tss {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.794650 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.swtpm_user = tss {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.795060 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.sysinfo_serial = unique {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.795441 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.tx_queue_size = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.795833 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.uid_maps = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.796217 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.use_virtio_for_bridges = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.796618 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.virt_type = kvm {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.797014 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.volume_clear = zero {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.797398 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.volume_clear_size = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.797839 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.volume_use_multipath = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.798221 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.vzstorage_cache_path = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.798618 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.799013 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.vzstorage_mount_group = qemu {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.799407 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.vzstorage_mount_opts = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.799799 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.800282 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.800683 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.vzstorage_mount_user = stack {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.801080 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.801527 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.auth_section = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.801935 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.auth_type = password {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.802315 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.802696 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.803084 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.803479 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.connect_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.803860 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.connect_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.804251 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.default_floating_pool = public {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.804625 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.endpoint_override = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.805009 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.extension_sync_interval = 600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.805390 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.http_retries = 3 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.805813 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.806195 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.806576 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.max_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.806984 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.807362 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.min_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.807779 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.ovs_bridge = br-int {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.808170 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.physnets = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.809103 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.region_name = RegionOne {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.809544 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.service_metadata_proxy = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.809925 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.service_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.810320 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.service_type = network {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.810707 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.811080 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.status_code_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.811453 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.status_code_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.811827 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.812273 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.812620 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] neutron.version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.813008 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] notifications.bdms_in_notifications = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.813424 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] notifications.default_level = INFO {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.813959 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] notifications.notification_format = unversioned {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.814265 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] notifications.notify_on_state_change = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.814602 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.815025 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] pci.alias = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.815414 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] pci.passthrough_whitelist = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.815836 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.auth_section = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.816253 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.auth_type = password {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.816673 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.auth_url = http://10.222.0.20/identity {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.817052 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.817428 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.817837 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.818213 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.connect_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.818610 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.connect_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.819005 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.default_domain_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.819380 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.default_domain_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.819759 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.domain_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.820141 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.domain_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.820515 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.endpoint_override = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.821792 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.821792 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.821792 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.max_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.822286 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.min_version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.822459 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.password = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.822820 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.project_domain_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.823226 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.project_domain_name = Default {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.823605 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.project_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.824738 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.project_name = service {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.824923 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.region_name = RegionOne {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.825288 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.service_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.825706 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.service_type = placement {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.826087 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.826464 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.status_code_retries = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.826839 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.status_code_retry_delay = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.827210 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.system_scope = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.827587 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.827960 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.trust_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.828339 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.user_domain_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.828739 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.user_domain_name = Default {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.829116 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.user_id = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.829551 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.username = placement {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.829967 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.830347 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] placement.version = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.830751 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] powervm.disk_driver = localdisk {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.831145 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] powervm.proc_units_factor = 0.1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.831540 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] powervm.volume_group_name = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.831961 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.cores = 20 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.832345 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.count_usage_from_placement = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.832854 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.833162 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.injected_file_content_bytes = 10240 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.833573 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.injected_file_path_length = 255 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.833971 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.injected_files = 5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.834360 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.instances = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.834770 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.key_pairs = 100 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.835131 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.metadata_items = 128 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.835524 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.ram = 51200 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.835903 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.recheck_quota = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.836286 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.server_group_members = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.836675 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] quota.server_groups = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.837064 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] rdp.enabled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.837703 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.838152 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.838558 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.838944 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.image_metadata_prefilter = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.839329 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.839741 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.max_attempts = 3 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.840130 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.max_placement_results = 1000 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.840532 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.840916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.query_placement_for_availability_zone = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.841306 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.query_placement_for_image_type_support = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.841713 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.842114 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] scheduler.workers = 2 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.842539 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.842961 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.843366 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.843752 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.844157 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.844549 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.844938 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.845376 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.846205 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.host_subset_size = 1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.846593 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.846977 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.847360 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.isolated_hosts = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.847761 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.isolated_images = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.848142 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.848526 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.848916 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.849304 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.849693 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.850080 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.850475 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.850862 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.851257 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.track_instance_changes = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.851660 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.856337 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] metrics.required = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.856337 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] metrics.weight_multiplier = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.856337 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.856337 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] metrics.weight_setting = [] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.856337 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.856337 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] serial_console.enabled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.856337 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] serial_console.port_range = 10000:20000 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.858013 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.858013 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.858013 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] serial_console.serialproxy_port = 6083 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.858013 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_user.auth_section = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.858013 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_user.auth_type = password {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.858013 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_user.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.858013 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_user.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.859078 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_user.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.859078 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_user.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.859078 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_user.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.859078 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_user.send_service_user_token = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.859625 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_user.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.859625 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] service_user.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.859913 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] spice.agent_enabled = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.860902 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] spice.enabled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.860902 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.862458 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.862458 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] spice.html5proxy_port = 6082 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.862458 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] spice.server_listen = 127.0.0.1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.862979 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.862979 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] upgrade_levels.baseapi = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.863273 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] upgrade_levels.cert = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.863666 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] upgrade_levels.compute = auto {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.864042 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] upgrade_levels.conductor = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.864424 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] upgrade_levels.scheduler = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.864808 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vendordata_dynamic_auth.auth_section = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.865210 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vendordata_dynamic_auth.auth_type = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.865613 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vendordata_dynamic_auth.cafile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.865994 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vendordata_dynamic_auth.certfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.866377 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.866759 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vendordata_dynamic_auth.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.867131 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vendordata_dynamic_auth.keyfile = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.867518 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.867885 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vendordata_dynamic_auth.timeout = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.868389 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.api_retry_count = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.868719 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.ca_file = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.869098 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.cache_prefix = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.869502 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.cluster_name = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.869868 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.connection_pool_size = 10 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.870297 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.console_delay_seconds = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.870660 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.datastore_regex = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.871557 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.host_ip = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.871936 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.host_password = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.872329 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.host_port = 443 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.872722 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.host_username = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.873103 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.insecure = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.873516 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.integration_bridge = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.873906 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.maximum_objects = 100 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.874302 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.pbm_default_policy = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.874678 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.pbm_enabled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.875049 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.pbm_wsdl_location = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.875443 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.875818 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.serial_port_proxy_uri = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.876190 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.serial_port_service_uri = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.876583 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.task_poll_interval = 0.5 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.876966 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.use_linked_clone = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.877375 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.vnc_keymap = en-us {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.877798 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.vnc_port = 5900 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.878184 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vmware.vnc_port_total = 10000 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.878649 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vnc.auth_schemes = ['none'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.879039 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vnc.enabled = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.879657 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.880060 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.880452 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vnc.novncproxy_port = 6080 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.880861 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vnc.server_listen = 127.0.0.1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.881627 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.882033 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vnc.vencrypt_ca_certs = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.882415 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vnc.vencrypt_client_cert = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.882789 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] vnc.vencrypt_client_key = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.883208 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.883596 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.883983 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.884364 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.disable_native_luksv1 = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.884744 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.disable_rootwrap = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.885125 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.enable_numa_live_migration = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.885547 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.885931 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.886310 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.libvirt_disable_apic = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.886750 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.887134 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.rbd_volume_local_attach = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.887515 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.887947 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.888833 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.client_socket_timeout = 900 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.889229 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.default_pool_size = 1000 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.889644 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.keep_alive = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.890032 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.max_header_line = 16384 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.890411 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.secure_proxy_ssl_header = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.890814 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.ssl_ca_file = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.891175 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.ssl_cert_file = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.891548 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.ssl_key_file = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.891937 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.tcp_keepidle = 600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.892338 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.892741 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] zvm.ca_file = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.893114 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] zvm.cloud_connector_url = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.893631 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.894015 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] zvm.reachable_timeout = 300 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.894467 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_policy.enforce_new_defaults = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.894853 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_policy.enforce_scope = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.895271 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_policy.policy_default_rule = default {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.895678 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.896095 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_policy.policy_file = policy.yaml {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.896528 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.896910 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.897306 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.897767 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.898155 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.898573 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.899012 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] profiler.connection_string = messaging:// {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.899418 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] profiler.enabled = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.899831 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] profiler.es_doc_type = notification {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.900229 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] profiler.es_scroll_size = 10000 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.900621 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] profiler.es_scroll_time = 2m {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.901002 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] profiler.filter_error_trace = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.901389 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] profiler.hmac_keys = SECRET_KEY {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.901803 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] profiler.sentinel_service_name = mymaster {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.902224 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] profiler.socket_timeout = 0.1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.902594 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] profiler.trace_sqlalchemy = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.903012 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] remote_debug.host = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.903411 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] remote_debug.port = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.903843 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.904235 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.904630 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.905015 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.905408 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.905824 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.906224 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.906629 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.907029 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.907407 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.907811 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.908198 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.908592 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.908984 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.909365 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.909792 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.910172 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.910559 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.911031 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.911366 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.911699 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.912095 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.ssl = False {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.912508 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.912913 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.913316 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.913735 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_rabbit.ssl_version = {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.914185 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.914568 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_notifications.retry = -1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.915013 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.915408 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_messaging_notifications.transport_url = **** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.915828 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_reports.file_event_handler = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.916226 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.916600 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] oslo_reports.log_dir = None {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:17:22.916917 n-d-802225-4 nova-conductor[100639]: DEBUG oslo_service.service [None req-1af9d3a1-3017-4b1a-a567-5b07270aba34 None None] ******************************************************************************** {{(pid=100639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:20:22.728985 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:20:22.748175 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:20:23.750268 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54390. Aug 27 02:20:23.769393 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54392. Aug 27 02:23:23.745913 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:23:23.765180 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:23:24.767029 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54464. Aug 27 02:23:24.784418 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54466. Aug 27 02:26:24.762961 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:26:24.780663 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:26:25.783733 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54584. Aug 27 02:26:25.804854 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54586. Aug 27 02:26:56.795898 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_db.sqlalchemy.engines [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Parent process 100639 forked (101511) with an open database connection, which is being discarded and recreated. {{(pid=101511) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Aug 27 02:26:57.511388 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:26:57.552545 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:26:57.555498 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:26:57.563628 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_db.sqlalchemy.engines [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:26:57.997068 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:26:57.998574 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:26:57.999331 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:26:57.999722 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:26:58.016015 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_db.sqlalchemy.engines [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:26:58.052388 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Getting quotas for project bfb59b50633a48f4a05bdc436f28cbb1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:26:58.058977 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Getting quotas for user d1a5573425ca4c8e833d5a322eecc074 and project bfb59b50633a48f4a05bdc436f28cbb1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:26:58.076443 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] [instance: 2ab52c31-c097-44b0-acc7-0753caf4f2ad] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:26:58.085194 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:26:58.089741 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:26:58.313773 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] [instance: 2ab52c31-c097-44b0-acc7-0753caf4f2ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:26:58.316401 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:26:58.316960 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:26:58.979372 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:26:58.979950 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:26:58.980482 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-dc74d82f-dee3-4481-9ede-1d1df1e32cbb tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Acquired lock "compute-rpcapi-router" {{(pid=101511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 02:26:58.981770 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-21cb2595-c187-41c1-8b22-42bde7705d3b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:26:58.982201 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-21cb2595-c187-41c1-8b22-42bde7705d3b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:26:58.987745 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-21cb2595-c187-41c1-8b22-42bde7705d3b None None] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:26:58.987745 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-21cb2595-c187-41c1-8b22-42bde7705d3b None None] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:26:58.993643 n-d-802225-4 nova-conductor[101511]: INFO nova.compute.rpcapi [None req-21cb2595-c187-41c1-8b22-42bde7705d3b None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 02:26:58.994468 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-21cb2595-c187-41c1-8b22-42bde7705d3b None None] Releasing lock "compute-rpcapi-router" {{(pid=101511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 02:27:03.627117 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_db.sqlalchemy.engines [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Parent process 100639 forked (101512) with an open database connection, which is being discarded and recreated. {{(pid=101512) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Aug 27 02:27:04.489108 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:27:04.562334 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:04.565983 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:04.576495 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_db.sqlalchemy.engines [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:27:05.300081 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:05.301943 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:05.302844 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:05.303901 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:05.332131 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_db.sqlalchemy.engines [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:27:05.375923 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Getting quotas for project 5e9980b5df0544caa6b06b536942ec7c. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:27:05.385188 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Getting quotas for user c37a3613e27f4b5b94af39beb65d941b and project 5e9980b5df0544caa6b06b536942ec7c. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:27:05.395519 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] [instance: 561e0c58-3060-40e9-9cc9-9aaeb4b7ebfc] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:27:05.396614 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:05.397097 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:05.473745 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] [instance: 561e0c58-3060-40e9-9cc9-9aaeb4b7ebfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:27:05.476937 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:05.477379 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:05.786186 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:05.786668 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:05.787458 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b1e-6b60-4b7a-8784-083c7fcfa335 tempest-AggregatesAdminTestJSON-831567868 tempest-AggregatesAdminTestJSON-831567868-project] Acquired lock "compute-rpcapi-router" {{(pid=101512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 02:27:05.790406 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-0eb10335-bffe-4ec2-98a5-7967decd59c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:05.790872 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-0eb10335-bffe-4ec2-98a5-7967decd59c4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:05.793173 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-0eb10335-bffe-4ec2-98a5-7967decd59c4 None None] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:05.795092 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-0eb10335-bffe-4ec2-98a5-7967decd59c4 None None] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:05.826089 n-d-802225-4 nova-conductor[101512]: INFO nova.compute.rpcapi [None req-0eb10335-bffe-4ec2-98a5-7967decd59c4 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 02:27:05.827024 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-0eb10335-bffe-4ec2-98a5-7967decd59c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=101512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 02:27:23.327591 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:27:23.346136 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:23.346800 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:23.658001 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:23.658409 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:23.666087 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:23.666087 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:23.681777 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Getting quotas for project d6fe4a025f4e4874a7762f30421ad479. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:27:23.685427 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Getting quotas for user 2c8bef6b86264cbaae5f1e1f01c2c97c and project d6fe4a025f4e4874a7762f30421ad479. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:27:23.694992 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] [instance: 72626090-11db-44a8-aa63-308f053c1cfc] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:27:23.695915 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:23.696317 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:23.838625 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] [instance: 72626090-11db-44a8-aa63-308f053c1cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:27:23.840653 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:23.841286 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:24.348569 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:24.349263 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de526a31-47ab-4014-96b8-9d91f9b2cdb3 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:33.146638 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:27:33.167334 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:33.167738 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:33.338221 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:33.338630 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:33.339342 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:33.339736 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:33.370123 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Getting quotas for project bfb59b50633a48f4a05bdc436f28cbb1. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:27:33.389114 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Getting quotas for user d1a5573425ca4c8e833d5a322eecc074 and project bfb59b50633a48f4a05bdc436f28cbb1. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:27:33.403340 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] [instance: 602e72ff-b80d-4283-980e-d68b7bb1f4c9] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:27:33.404375 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:33.404847 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:33.523504 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] [instance: 602e72ff-b80d-4283-980e-d68b7bb1f4c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:27:33.524792 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:33.525218 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:34.087274 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:34.088494 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3736b840-e410-4c0f-85b1-6ea450ca1ec1 tempest-DeleteServersAdminTestJSON-134299679 tempest-DeleteServersAdminTestJSON-134299679-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:38.234429 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:27:38.275168 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:38.275578 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:38.568167 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:38.568695 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:38.569729 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:38.570246 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:38.599990 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Getting quotas for project 6f9d365a3f974835b63666c4a3834c04. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:27:38.611089 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Getting quotas for user efe20016a34c420cb5b6460c6d0e13d9 and project 6f9d365a3f974835b63666c4a3834c04. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:27:38.638052 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] [instance: 3c42e621-eda1-41c7-8b1f-f22889d0294b] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:27:38.639086 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:38.639460 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:38.654747 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:27:38.673078 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:38.673519 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:38.719444 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] [instance: 3c42e621-eda1-41c7-8b1f-f22889d0294b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:27:38.726039 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:38.726039 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:38.946420 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:38.947292 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:38.952304 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:38.952900 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:38.972546 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Getting quotas for project 7403936fa41f472f8dbdb3fc7de7c8bd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:27:38.976902 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Getting quotas for user bcd9176f44bd4c829737c40b63674a02 and project 7403936fa41f472f8dbdb3fc7de7c8bd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:27:39.004171 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] [instance: 9348cd9e-0ac5-4e90-98c8-d42b189d2980] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:27:39.008528 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:39.009126 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:39.068891 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:39.069413 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0cbe9fd8-2a88-453a-a99d-2012f44d7b10 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:39.094965 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] [instance: 9348cd9e-0ac5-4e90-98c8-d42b189d2980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:27:39.097562 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:39.098387 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:39.415460 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:39.418230 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6df2846b-0318-44a9-b1bf-3bbab999788a tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:55.232722 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-09023c22-57e9-4763-8393-2c08d0392bce tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:27:55.233954 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-09023c22-57e9-4763-8393-2c08d0392bce tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:55.234556 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-09023c22-57e9-4763-8393-2c08d0392bce tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:56.154220 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-09023c22-57e9-4763-8393-2c08d0392bce tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Created allocations for migration 5ece9f5a-2a0d-49dc-a3f1-11bde7ff8214 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101511) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:27:56.713778 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-f7cd0983-a06a-412c-8b11-e875cd275a7f tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:27:56.714297 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f7cd0983-a06a-412c-8b11-e875cd275a7f tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:27:56.714935 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f7cd0983-a06a-412c-8b11-e875cd275a7f tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:27:56.716247 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.utils [None req-09023c22-57e9-4763-8393-2c08d0392bce tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] [instance: 72626090-11db-44a8-aa63-308f053c1cfc] Instance allocations successfully created on destination node 8f1d7267-4d7c-4650-83e0-62766d0c0a07: {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101511) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Aug 27 02:27:56.716680 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-09023c22-57e9-4763-8393-2c08d0392bce tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lazy-loading 'resources' on Instance uuid 72626090-11db-44a8-aa63-308f053c1cfc {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:27:56.724266 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-09023c22-57e9-4763-8393-2c08d0392bce tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lazy-loading 'pci_requests' on Instance uuid 72626090-11db-44a8-aa63-308f053c1cfc {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:27:57.830987 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-f7cd0983-a06a-412c-8b11-e875cd275a7f tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Created allocations for migration 9437c684-d3ef-48b8-8e29-60a90da71c0a on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:27:57.994100 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.utils [None req-f7cd0983-a06a-412c-8b11-e875cd275a7f tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] [instance: 3c42e621-eda1-41c7-8b1f-f22889d0294b] Instance allocations successfully created on destination node 8f1d7267-4d7c-4650-83e0-62766d0c0a07: {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101512) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Aug 27 02:27:57.994731 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance [None req-f7cd0983-a06a-412c-8b11-e875cd275a7f tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lazy-loading 'resources' on Instance uuid 3c42e621-eda1-41c7-8b1f-f22889d0294b {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:27:58.003737 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance [None req-f7cd0983-a06a-412c-8b11-e875cd275a7f tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lazy-loading 'pci_requests' on Instance uuid 3c42e621-eda1-41c7-8b1f-f22889d0294b {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:27:58.135686 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.live_migrate [None req-09023c22-57e9-4763-8393-2c08d0392bce tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] [instance: 72626090-11db-44a8-aa63-308f053c1cfc] Start binding ports on destination host: n-h2-802225-4 {{(pid=101511) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Aug 27 02:27:58.698390 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.live_migrate [None req-f7cd0983-a06a-412c-8b11-e875cd275a7f tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] [instance: 3c42e621-eda1-41c7-8b1f-f22889d0294b] Start binding ports on destination host: n-h2-802225-4 {{(pid=101512) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Aug 27 02:28:00.499281 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:28:00.521551 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:00.521960 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:00.678557 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:00.678557 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:00.678557 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:00.678557 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:00.693011 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Getting quotas for project d73d13e0fe5b4e2b91ad1b52d2bba0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:28:00.697209 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Getting quotas for user 50f1bbec8fea40cf9c0b80864e8e62ca and project d73d13e0fe5b4e2b91ad1b52d2bba0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:28:00.707586 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: 11a16193-67bf-4f16-a5ef-8c515d79b342] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:28:00.708514 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:00.708906 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:00.813226 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: 11a16193-67bf-4f16-a5ef-8c515d79b342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:28:00.818644 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:00.818644 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:01.082960 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:01.083382 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ecc81bf-4594-4f10-aaaa-4289aada070e tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:05.581599 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:28:05.655721 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:05.656295 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:05.842244 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:05.842244 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:05.842244 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:05.842244 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:05.885952 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Getting quotas for project 7403936fa41f472f8dbdb3fc7de7c8bd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:28:05.897890 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Getting quotas for user bcd9176f44bd4c829737c40b63674a02 and project 7403936fa41f472f8dbdb3fc7de7c8bd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:28:05.914556 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] [instance: e8e5bdbd-f23c-40ca-9435-5a378116583e] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:28:05.916307 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:05.921170 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:05.991328 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] [instance: e8e5bdbd-f23c-40ca-9435-5a378116583e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:28:05.992584 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:05.992992 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:06.210085 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:06.210551 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-54b3ea94-c635-4ce8-8d2c-5b3812fd5067 tempest-ServersAdminNegativeTestJSON-292957615 tempest-ServersAdminNegativeTestJSON-292957615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:17.186674 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:28:17.225838 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:17.226251 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:17.413979 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:17.448952 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:17.448952 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:17.448952 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:17.470002 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Getting quotas for project 345925a9f21449b587222091faed6704. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:28:17.485035 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Getting quotas for user 05a419afeae04c72adf831ccb0fe99aa and project 345925a9f21449b587222091faed6704. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:28:17.509843 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] [instance: 3ace0e4f-a6e4-4e3c-a506-fd7279d939ee] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:28:17.510866 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:17.511330 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:18.008816 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] [instance: 3ace0e4f-a6e4-4e3c-a506-fd7279d939ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:28:18.012263 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:18.012974 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:18.222341 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:18.223076 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea4ecebe-2d4f-4e91-89ff-b580cfd3b2cf tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:18.520177 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:28:18.543494 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:18.544127 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:18.724890 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:18.725572 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:18.727723 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:18.728410 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:18.756519 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Getting quotas for project d6fe4a025f4e4874a7762f30421ad479. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:28:18.760943 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Getting quotas for user 2c8bef6b86264cbaae5f1e1f01c2c97c and project d6fe4a025f4e4874a7762f30421ad479. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:28:18.787864 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] [instance: 9f25301d-89bc-40dc-8458-40e9633393f3] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:28:18.790974 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:18.791395 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:18.882078 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] [instance: 9f25301d-89bc-40dc-8458-40e9633393f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:28:18.883507 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:18.884243 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:19.186774 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:19.187117 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c667729d-dfca-49ac-b388-e42a4597b9c6 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:20.405727 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:28:20.426470 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:20.426886 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:20.625819 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:20.626506 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:20.627611 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:20.628161 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:20.688853 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Getting quotas for project 75d3c8cc393046218ca61c1a9d0daaef. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:28:20.701025 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Getting quotas for user a7c7338136c14d7a92c60d44557e0ef3 and project 75d3c8cc393046218ca61c1a9d0daaef. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:28:20.729930 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] [instance: cc84ef8e-ec84-42cf-b9fa-322e47d06ba1] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:28:20.731098 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:20.732179 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:20.846754 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] [instance: cc84ef8e-ec84-42cf-b9fa-322e47d06ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:28:20.855164 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:20.855725 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:21.227215 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:21.227877 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ccba321f-6ee3-4970-92df-cc7bb6319079 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:21.790693 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:28:21.791694 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:21.803929 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:22.087142 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] [instance: 11a16193-67bf-4f16-a5ef-8c515d79b342] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101512) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 02:28:22.827078 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Created allocations for migration e6c8547e-0891-4495-9bdd-c37525a4a060 on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:28:23.295615 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] [instance: 11a16193-67bf-4f16-a5ef-8c515d79b342] Calling prep_resize with selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [] {{(pid=101512) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 02:28:23.729560 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.client.report [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Overwriting current allocation {'allocations': {'6e12de08-5d57-48b3-b442-9a192ba4e475': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}, 'generation': 11}}, 'project_id': 'd73d13e0fe5b4e2b91ad1b52d2bba0e0', 'user_id': '50f1bbec8fea40cf9c0b80864e8e62ca', 'consumer_generation': 1} on consumer 11a16193-67bf-4f16-a5ef-8c515d79b342 {{(pid=101512) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 02:28:23.899148 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Created allocations for instance 11a16193-67bf-4f16-a5ef-8c515d79b342 on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101512) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 02:28:24.021611 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:28:24.023539 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] [instance: 11a16193-67bf-4f16-a5ef-8c515d79b342] Setting instance to ACTIVE state. Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server [None req-c1f1bc93-4405-47e7-85ee-ec8e2b300b1d tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 02:28:24.499918 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 02:28:24.504500 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 02:28:24.505602 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:28:24.505602 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Aug 27 02:28:24.997069 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:28:25.024958 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:25.025375 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:25.239007 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:25.241819 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:25.242712 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:25.247080 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:25.267759 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Getting quotas for project 340e0807283a475c89566b5ee4a38254. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:28:25.272640 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Getting quotas for user 676114cd4dec469eb2e813145efc49c6 and project 340e0807283a475c89566b5ee4a38254. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:28:25.292105 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] [instance: cc9e464a-847f-416b-9e55-7bfd8a0dfbc1] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:28:25.293308 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:25.293835 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:25.374166 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] [instance: cc9e464a-847f-416b-9e55-7bfd8a0dfbc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:28:25.375790 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:25.376299 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:25.661104 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:25.661549 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c61d40dc-1a27-44a5-9562-aa1a05a3c51c tempest-ServersTestManualDisk-903689752 tempest-ServersTestManualDisk-903689752-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:31.320318 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:28:31.341961 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:31.342552 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:31.489582 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:31.489991 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:31.490931 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:31.491331 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:31.509050 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Getting quotas for project 6f9d365a3f974835b63666c4a3834c04. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:28:31.512785 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Getting quotas for user efe20016a34c420cb5b6460c6d0e13d9 and project 6f9d365a3f974835b63666c4a3834c04. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:28:31.523193 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] [instance: cd603edf-7c74-4720-8b2e-89949726b370] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:28:31.524128 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:31.524535 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:31.624593 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] [instance: cd603edf-7c74-4720-8b2e-89949726b370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:28:31.625992 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:31.626386 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:31.963683 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:31.964159 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-055ae7e8-781a-4e35-848f-76ac0cede228 tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:43.577409 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-3738114a-93fa-42ce-ad16-c41d9f666fe9 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:28:43.577409 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3738114a-93fa-42ce-ad16-c41d9f666fe9 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:43.577409 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3738114a-93fa-42ce-ad16-c41d9f666fe9 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:45.055372 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-3738114a-93fa-42ce-ad16-c41d9f666fe9 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Created allocations for migration 099a9493-ef95-4de9-a903-e466a633a1d2 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101511) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:28:45.209970 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.utils [None req-3738114a-93fa-42ce-ad16-c41d9f666fe9 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] [instance: 9f25301d-89bc-40dc-8458-40e9633393f3] Instance allocations successfully created on destination node 8f1d7267-4d7c-4650-83e0-62766d0c0a07: {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101511) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Aug 27 02:28:45.210375 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-3738114a-93fa-42ce-ad16-c41d9f666fe9 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lazy-loading 'resources' on Instance uuid 9f25301d-89bc-40dc-8458-40e9633393f3 {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:28:45.215341 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-3738114a-93fa-42ce-ad16-c41d9f666fe9 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lazy-loading 'pci_requests' on Instance uuid 9f25301d-89bc-40dc-8458-40e9633393f3 {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:28:45.814919 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.live_migrate [None req-3738114a-93fa-42ce-ad16-c41d9f666fe9 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] [instance: 9f25301d-89bc-40dc-8458-40e9633393f3] Start binding ports on destination host: n-h2-802225-4 {{(pid=101511) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Aug 27 02:28:50.184244 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:28:50.205076 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:50.205502 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:50.464748 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:50.465172 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:50.465921 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:50.466567 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:50.482502 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Getting quotas for project 8edfa98d377a404abd79176e76061fcc. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:28:50.486316 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Getting quotas for user dd71e45c0ca344efaa9c777567528e89 and project 8edfa98d377a404abd79176e76061fcc. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:28:50.496020 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] [instance: 55c45376-9fab-48a8-923c-51d37637aa78] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:28:50.496954 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:50.497364 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:50.523903 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-98e20865-ea6e-451d-a639-4e6ff380222b tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:28:50.524416 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-98e20865-ea6e-451d-a639-4e6ff380222b tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:50.524780 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-98e20865-ea6e-451d-a639-4e6ff380222b tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:50.612975 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] [instance: 55c45376-9fab-48a8-923c-51d37637aa78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:28:50.614542 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:50.615279 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:51.108789 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:28:51.109207 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f00fecf3-30cf-43c9-a931-5944f0e851e6 tempest-VolumesAdminNegativeTest-1584150597 tempest-VolumesAdminNegativeTest-1584150597-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:28:51.312094 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-98e20865-ea6e-451d-a639-4e6ff380222b tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Created allocations for migration 08b798d3-cee1-4cb0-87e4-8e45cb5c85c1 on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101511) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:28:51.565063 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.utils [None req-98e20865-ea6e-451d-a639-4e6ff380222b tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] [instance: cd603edf-7c74-4720-8b2e-89949726b370] Instance allocations successfully created on destination node 6e12de08-5d57-48b3-b442-9a192ba4e475: {'allocations': {'6e12de08-5d57-48b3-b442-9a192ba4e475': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101511) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Aug 27 02:28:51.566220 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-98e20865-ea6e-451d-a639-4e6ff380222b tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lazy-loading 'resources' on Instance uuid cd603edf-7c74-4720-8b2e-89949726b370 {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:28:51.570948 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-98e20865-ea6e-451d-a639-4e6ff380222b tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lazy-loading 'pci_requests' on Instance uuid cd603edf-7c74-4720-8b2e-89949726b370 {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:28:52.441038 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.live_migrate [None req-98e20865-ea6e-451d-a639-4e6ff380222b tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] [instance: cd603edf-7c74-4720-8b2e-89949726b370] Start binding ports on destination host: n-h1-802225-4 {{(pid=101511) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Aug 27 02:29:00.185370 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Took 1.33 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:29:00.208888 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:00.209374 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:00.324897 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:00.325307 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:00.326071 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:00.326554 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:00.341706 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Getting quotas for project d6fe4a025f4e4874a7762f30421ad479. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:29:00.345509 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Getting quotas for user 2c8bef6b86264cbaae5f1e1f01c2c97c and project d6fe4a025f4e4874a7762f30421ad479. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:29:00.355820 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] [instance: 706aec8f-afdc-479a-a38c-c5850a083724] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:29:00.357020 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:00.357430 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:00.441294 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] [instance: 706aec8f-afdc-479a-a38c-c5850a083724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:29:00.442558 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:00.442961 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:00.706469 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:00.706901 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f4f7c418-25d2-49f0-9c28-5d6c9715b715 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:03.551050 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:29:03.573266 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:03.573750 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:03.700619 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:03.704620 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:03.706692 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:03.708689 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:03.751569 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Getting quotas for project 345925a9f21449b587222091faed6704. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:29:03.770014 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Getting quotas for user 05a419afeae04c72adf831ccb0fe99aa and project 345925a9f21449b587222091faed6704. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:29:03.802275 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] [instance: c9f475e1-ef18-47e3-8ac9-3516adb1c880] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:29:03.804806 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:03.806427 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:03.916073 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] [instance: c9f475e1-ef18-47e3-8ac9-3516adb1c880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:29:03.920819 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:03.921236 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:04.259635 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:04.260391 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6cfe8fac-e733-4162-a06a-30d1bb54086a tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:04.959644 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:29:04.987725 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:04.987725 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:05.181871 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:05.182326 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:05.185772 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:05.185772 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:05.198856 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Getting quotas for project a2e503034bed43f0ab11dd1d2e162dc6. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:29:05.202513 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Getting quotas for user 057fa0fdadd046ce9da78f99f06347c2 and project a2e503034bed43f0ab11dd1d2e162dc6. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:29:05.213704 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] [instance: 84e052e6-8020-4b6b-aa4f-eeb04fcacc35] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:29:05.214681 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:05.215167 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:05.281019 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] [instance: 84e052e6-8020-4b6b-aa4f-eeb04fcacc35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:29:05.282952 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:05.283386 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:05.467072 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:05.471528 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-82a28c05-1650-4569-952c-2a2e3a5a5034 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:06.009479 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Took 2.78 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:29:06.029386 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:06.029822 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:06.189778 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:06.191440 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:06.192800 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:06.193792 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:06.214122 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Getting quotas for project a2e503034bed43f0ab11dd1d2e162dc6. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:29:06.218044 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Getting quotas for user 057fa0fdadd046ce9da78f99f06347c2 and project a2e503034bed43f0ab11dd1d2e162dc6. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:29:06.234381 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] [instance: d98d1664-c302-4474-b8b6-3db0ce9c03f0] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:29:06.235636 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:06.236299 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:06.321335 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] [instance: d98d1664-c302-4474-b8b6-3db0ce9c03f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:29:06.322911 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:06.323339 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:06.516838 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:06.517542 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75d07614-a3a5-4a07-82b8-7c8df1b366be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:07.522754 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:29:07.541385 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:07.541828 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:07.663725 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:07.664136 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:07.664922 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:07.665322 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:07.684481 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Getting quotas for project 6f9d365a3f974835b63666c4a3834c04. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:29:07.688142 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Getting quotas for user efe20016a34c420cb5b6460c6d0e13d9 and project 6f9d365a3f974835b63666c4a3834c04. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:29:07.702226 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] [instance: d6a0247e-4e21-4f17-aef2-d2c7a47d7fef] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:29:07.705847 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:07.705847 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:07.783813 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] [instance: d6a0247e-4e21-4f17-aef2-d2c7a47d7fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:29:07.785184 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:07.797574 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:08.168137 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:08.168720 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-f9a65da6-19d2-4784-afe8-a96a853f822a tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:27.456513 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:29:27.474937 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:27.475349 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:27.709000 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:27.709412 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:27.715054 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:27.715468 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:27.732415 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Getting quotas for project a2e503034bed43f0ab11dd1d2e162dc6. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:29:27.737321 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Getting quotas for user 057fa0fdadd046ce9da78f99f06347c2 and project a2e503034bed43f0ab11dd1d2e162dc6. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:29:27.747872 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] [instance: 63cf40ed-ee72-4db9-8a2f-c3c333a732a8] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:29:27.749579 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:27.750654 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:27.858015 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] [instance: 63cf40ed-ee72-4db9-8a2f-c3c333a732a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:29:27.864498 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:27.864498 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:28.247386 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:28.248088 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b46f2a8a-798f-444f-92c1-fb0942b1aa55 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:34.437387 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-5fd4c2c8-93db-4b66-a89e-101d6b8c445b tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:29:34.438006 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5fd4c2c8-93db-4b66-a89e-101d6b8c445b tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:34.438306 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5fd4c2c8-93db-4b66-a89e-101d6b8c445b tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:35.106638 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-5fd4c2c8-93db-4b66-a89e-101d6b8c445b tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Created allocations for migration 924bb10f-b24e-4433-a5be-6b1ef6bef02e on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:29:35.327927 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.utils [None req-5fd4c2c8-93db-4b66-a89e-101d6b8c445b tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] [instance: 706aec8f-afdc-479a-a38c-c5850a083724] Instance allocations successfully created on destination node 8f1d7267-4d7c-4650-83e0-62766d0c0a07: {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101512) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Aug 27 02:29:35.328410 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance [None req-5fd4c2c8-93db-4b66-a89e-101d6b8c445b tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lazy-loading 'resources' on Instance uuid 706aec8f-afdc-479a-a38c-c5850a083724 {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:29:35.333545 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance [None req-5fd4c2c8-93db-4b66-a89e-101d6b8c445b tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lazy-loading 'pci_requests' on Instance uuid 706aec8f-afdc-479a-a38c-c5850a083724 {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:29:35.958726 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.live_migrate [None req-5fd4c2c8-93db-4b66-a89e-101d6b8c445b tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] [instance: 706aec8f-afdc-479a-a38c-c5850a083724] Start binding ports on destination host: n-h2-802225-4 {{(pid=101512) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Aug 27 02:29:37.938843 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:29:37.958866 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:37.959544 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:38.154517 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:38.155074 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:38.156187 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:38.157658 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:38.183053 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Getting quotas for project 345925a9f21449b587222091faed6704. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:29:38.187283 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Getting quotas for user 05a419afeae04c72adf831ccb0fe99aa and project 345925a9f21449b587222091faed6704. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:29:38.199150 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] [instance: d5b8fb7d-854c-40c5-9de3-6943c558baaa] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:29:38.200887 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:38.201522 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:38.320698 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] [instance: d5b8fb7d-854c-40c5-9de3-6943c558baaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:29:38.323273 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:38.324113 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:38.740000 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:38.740992 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d7830b-566e-43d0-806c-c17310f43d9b tempest-ImagesOneServerNegativeTestJSON-1328151234 tempest-ImagesOneServerNegativeTestJSON-1328151234-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:40.776512 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-dc0dbbe8-91a1-4e4a-bad7-0ee3fe7f46b8 tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:29:40.776997 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-dc0dbbe8-91a1-4e4a-bad7-0ee3fe7f46b8 tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:40.777396 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-dc0dbbe8-91a1-4e4a-bad7-0ee3fe7f46b8 tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:41.667442 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-dc0dbbe8-91a1-4e4a-bad7-0ee3fe7f46b8 tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Created allocations for migration 480b14ae-666f-4c3c-bd98-42abb1fe6bbd on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:29:41.918014 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.utils [None req-dc0dbbe8-91a1-4e4a-bad7-0ee3fe7f46b8 tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] [instance: d6a0247e-4e21-4f17-aef2-d2c7a47d7fef] Instance allocations successfully created on destination node 6e12de08-5d57-48b3-b442-9a192ba4e475: {'allocations': {'6e12de08-5d57-48b3-b442-9a192ba4e475': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=101512) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Aug 27 02:29:41.918702 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance [None req-dc0dbbe8-91a1-4e4a-bad7-0ee3fe7f46b8 tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lazy-loading 'resources' on Instance uuid d6a0247e-4e21-4f17-aef2-d2c7a47d7fef {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:29:41.924085 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance [None req-dc0dbbe8-91a1-4e4a-bad7-0ee3fe7f46b8 tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lazy-loading 'pci_requests' on Instance uuid d6a0247e-4e21-4f17-aef2-d2c7a47d7fef {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:29:42.581015 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.live_migrate [None req-dc0dbbe8-91a1-4e4a-bad7-0ee3fe7f46b8 tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] [instance: d6a0247e-4e21-4f17-aef2-d2c7a47d7fef] Start binding ports on destination host: n-h1-802225-4 {{(pid=101512) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Aug 27 02:29:50.780445 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9ec8a696-e1dd-4b09-a221-b7bd6ae619be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method rebuild_instance {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:29:50.781034 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9ec8a696-e1dd-4b09-a221-b7bd6ae619be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:29:50.781636 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9ec8a696-e1dd-4b09-a221-b7bd6ae619be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:29:50.895295 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9ec8a696-e1dd-4b09-a221-b7bd6ae619be tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] [instance: d98d1664-c302-4474-b8b6-3db0ce9c03f0] No migration record for the rebuild/evacuate request. {{(pid=101511) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Aug 27 02:30:17.905864 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:30:17.928341 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:17.929111 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:18.144504 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:18.145380 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:18.151493 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:18.151493 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:18.175581 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Getting quotas for project 917ec4933f9b4c7c958d5a89a4856a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:30:18.179777 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Getting quotas for user 57c2621d8d0f48ceb57a9abb532debc9 and project 917ec4933f9b4c7c958d5a89a4856a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:30:18.190920 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] [instance: a51a7b77-5479-4c7e-a699-16a7867da039] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:30:18.191867 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:18.192281 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:18.257048 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] [instance: a51a7b77-5479-4c7e-a699-16a7867da039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:30:18.259240 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:18.261830 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:18.550175 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:18.550822 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6e43908f-da83-4da1-9c67-a5cecd427887 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:18.982627 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:30:19.038754 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:19.039166 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:19.185136 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:19.185713 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:19.186880 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:19.187597 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:19.205756 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Getting quotas for project 917ec4933f9b4c7c958d5a89a4856a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:30:19.218468 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Getting quotas for user 57c2621d8d0f48ceb57a9abb532debc9 and project 917ec4933f9b4c7c958d5a89a4856a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:30:19.234529 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] [instance: 2d7ab5ef-3740-4721-8bbd-09ba456acde3] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:30:19.236855 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:19.237414 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:19.325809 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] [instance: 2d7ab5ef-3740-4721-8bbd-09ba456acde3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:30:19.327341 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:19.330919 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:19.643140 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:19.643869 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e7c6d416-7002-4155-a8ee-d544dbc93494 tempest-ListImageFiltersTestJSON-32513423 tempest-ListImageFiltersTestJSON-32513423-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:20.656525 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-08c2d906-f62c-42fc-a397-417383483a07 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method rebuild_instance {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:30:20.658338 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08c2d906-f62c-42fc-a397-417383483a07 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:20.659164 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08c2d906-f62c-42fc-a397-417383483a07 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:20.747720 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-08c2d906-f62c-42fc-a397-417383483a07 tempest-ServersAdminTestJSON-1188678274 tempest-ServersAdminTestJSON-1188678274-project] [instance: d98d1664-c302-4474-b8b6-3db0ce9c03f0] No migration record for the rebuild/evacuate request. {{(pid=101512) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Aug 27 02:30:21.320264 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:30:21.365915 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:21.366327 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:21.593433 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:21.594707 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:21.596276 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:21.601574 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:21.646601 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Getting quotas for project 75d3c8cc393046218ca61c1a9d0daaef. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:30:21.650929 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Getting quotas for user a7c7338136c14d7a92c60d44557e0ef3 and project 75d3c8cc393046218ca61c1a9d0daaef. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:30:21.669179 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] [instance: cc81b449-62c8-4a51-9fcd-524356eabfa4] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:30:21.670219 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:21.670627 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:21.741760 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] [instance: cc81b449-62c8-4a51-9fcd-524356eabfa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:30:21.743324 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:21.743877 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:21.828788 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:21.830925 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:22.185123 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:30:22.185988 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-97830444-013a-4b84-bf1a-4b651e98d578 tempest-ServersWithSpecificFlavorTestJSON-1683998331 tempest-ServersWithSpecificFlavorTestJSON-1683998331-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:30:56.750947 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:30:57.772771 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33524. Aug 27 02:31:09.552828 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:31:09.576112 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:09.576788 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:09.795457 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:09.796228 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:09.798573 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:09.799136 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:09.820961 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Getting quotas for project d6fe4a025f4e4874a7762f30421ad479. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:31:09.826892 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Getting quotas for user 2c8bef6b86264cbaae5f1e1f01c2c97c and project d6fe4a025f4e4874a7762f30421ad479. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:31:09.847884 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] [instance: a0eadf65-946b-4bc7-b16d-84186a03808b] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:31:09.849730 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:09.850334 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:10.038029 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] [instance: a0eadf65-946b-4bc7-b16d-84186a03808b] block_device_mapping [BlockDeviceMapping(attachment_id=b47aed2d-b460-499c-8916-d894618416e2,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc703d21-9dfb-472f-8fec-c5944f170152',volume_size=1,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:31:10.039853 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:10.040489 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:11.161272 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:11.162034 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4be4a8db-fd6d-4af7-a6fa-6056f572c137 tempest-LiveAutoBlockMigrationV225Test-178134702 tempest-LiveAutoBlockMigrationV225Test-178134702-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:18.524294 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:31:18.548394 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:18.548878 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:18.755153 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:18.755693 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:18.756810 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:18.757371 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:18.772514 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Getting quotas for project 6f9d365a3f974835b63666c4a3834c04. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:31:18.776093 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Getting quotas for user efe20016a34c420cb5b6460c6d0e13d9 and project 6f9d365a3f974835b63666c4a3834c04. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:31:18.785609 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] [instance: 236bbd3e-8007-4f66-b7dd-2d1f0507fd37] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:31:18.786533 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:18.786933 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:18.850460 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] [instance: 236bbd3e-8007-4f66-b7dd-2d1f0507fd37] block_device_mapping [BlockDeviceMapping(attachment_id=3ad56bcf-ad48-4404-9432-5e97d4799454,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7b2f237-3966-4c7d-bc53-179911fd9a23',volume_size=1,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:31:18.851774 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:18.852209 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:19.110765 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:19.110765 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0423f621-27ca-4e09-b4a0-3fc78a93780f tempest-LiveMigrationTest-2097628690 tempest-LiveMigrationTest-2097628690-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:34.049759 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:31:34.079183 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:34.079743 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:34.389122 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:34.389122 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:34.389122 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:34.389122 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:34.407617 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Getting quotas for project 0368577cee7c4fa4a592e711e789c985. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:31:34.411276 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Getting quotas for user 593d3902a15a49e496827d7d28098d9c and project 0368577cee7c4fa4a592e711e789c985. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:31:34.421503 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] [instance: 8807ea03-31a1-42fc-9862-0b2a42f1c3f2] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:31:34.422670 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:34.423345 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:34.502032 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] [instance: 8807ea03-31a1-42fc-9862-0b2a42f1c3f2] block_device_mapping [BlockDeviceMapping(attachment_id=9da86c02-637f-4a9d-b22d-80ec41042796,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3f29ae77-3c8d-473a-b096-1695632786f1',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=66436ae4-07bc-409d-8a6b-94376bc7cabb,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a8542a60-d3ef-45d2-bffe-3c9dd95edd9c',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=79d6f907-8a03-4423-9178-325a372df320,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe503212-02c8-49f2-a5d0-4425dfe4fb9a',volume_size=1,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:31:34.504047 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:34.504455 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:34.608932 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:34.609339 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:34.637266 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d83aa18a-1695-4136-a110-6cca55d0b374 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:31:34.638534 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d83aa18a-1695-4136-a110-6cca55d0b374 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:34.646052 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d83aa18a-1695-4136-a110-6cca55d0b374 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:34.746007 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:34.747020 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:35.241908 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:35.244059 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec3b9ac0-b872-4760-99d1-598be51c07de tempest-TaggedBootDevicesTest_v242-818104206 tempest-TaggedBootDevicesTest_v242-818104206-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:35.492837 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-d83aa18a-1695-4136-a110-6cca55d0b374 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Created allocations for migration 85cf1e74-87ba-4941-9cee-9772702cb9a8 on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101511) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:31:35.816037 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.utils [None req-d83aa18a-1695-4136-a110-6cca55d0b374 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] [instance: a0eadf65-946b-4bc7-b16d-84186a03808b] Instance allocations successfully created on destination node 6e12de08-5d57-48b3-b442-9a192ba4e475: {'allocations': {'6e12de08-5d57-48b3-b442-9a192ba4e475': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=101511) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Aug 27 02:31:35.818230 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-d83aa18a-1695-4136-a110-6cca55d0b374 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lazy-loading 'resources' on Instance uuid a0eadf65-946b-4bc7-b16d-84186a03808b {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:31:35.823529 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-d83aa18a-1695-4136-a110-6cca55d0b374 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] Lazy-loading 'pci_requests' on Instance uuid a0eadf65-946b-4bc7-b16d-84186a03808b {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:31:36.898899 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.live_migrate [None req-d83aa18a-1695-4136-a110-6cca55d0b374 tempest-LiveAutoBlockMigrationV225Test-54688347 tempest-LiveAutoBlockMigrationV225Test-54688347-project-admin] [instance: a0eadf65-946b-4bc7-b16d-84186a03808b] Start binding ports on destination host: n-h1-802225-4 {{(pid=101511) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Aug 27 02:31:46.888029 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-40ad74cd-e421-40de-8a3f-8f6813c3f17c tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:31:46.888029 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-40ad74cd-e421-40de-8a3f-8f6813c3f17c tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:31:46.888029 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-40ad74cd-e421-40de-8a3f-8f6813c3f17c tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:31:47.818587 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-40ad74cd-e421-40de-8a3f-8f6813c3f17c tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Created allocations for migration ec21cd3d-b267-4d21-af0c-bb9821764e38 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:31:48.017082 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.utils [None req-40ad74cd-e421-40de-8a3f-8f6813c3f17c tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] [instance: 236bbd3e-8007-4f66-b7dd-2d1f0507fd37] Instance allocations successfully created on destination node 8f1d7267-4d7c-4650-83e0-62766d0c0a07: {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=101512) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Aug 27 02:31:48.017082 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance [None req-40ad74cd-e421-40de-8a3f-8f6813c3f17c tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lazy-loading 'resources' on Instance uuid 236bbd3e-8007-4f66-b7dd-2d1f0507fd37 {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:31:48.022562 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance [None req-40ad74cd-e421-40de-8a3f-8f6813c3f17c tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] Lazy-loading 'pci_requests' on Instance uuid 236bbd3e-8007-4f66-b7dd-2d1f0507fd37 {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:31:48.673539 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.live_migrate [None req-40ad74cd-e421-40de-8a3f-8f6813c3f17c tempest-LiveMigrationTest-184097345 tempest-LiveMigrationTest-184097345-project-admin] [instance: 236bbd3e-8007-4f66-b7dd-2d1f0507fd37] Start binding ports on destination host: n-h2-802225-4 {{(pid=101512) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Aug 27 02:32:11.075108 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:32:11.131749 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:11.135090 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:11.709390 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:11.709390 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:11.709390 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:11.709390 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:11.758761 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Getting quotas for project fca2528af41f4b8b81b14220881e7952. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:32:11.766472 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Getting quotas for user ac73e71796404757beeef52e3b221ca3 and project fca2528af41f4b8b81b14220881e7952. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:32:11.799966 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] [instance: 69e91d69-0637-4826-b3ec-9d99370904e3] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:32:11.802369 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:11.803749 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:11.937011 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] [instance: 69e91d69-0637-4826-b3ec-9d99370904e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:32:11.939205 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:11.940120 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:12.295719 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:12.305368 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-063142f3-0ce7-4f67-b506-c62c661bced6 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:19.606820 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Took 0.64 seconds to select destinations for 2 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:32:19.636498 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:19.636862 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:20.049632 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:20.049956 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:20.619164 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:20.619786 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:20.620693 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:20.621256 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:20.641077 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Getting quotas for project bafb7288997e4bc9b8b916d808c6dfa9. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:32:20.646083 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Getting quotas for user 8c7a3219adb843548269f90ac2349c5d and project bafb7288997e4bc9b8b916d808c6dfa9. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:32:20.657731 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] [instance: 0bd2e22c-e10d-4a18-aeb0-9a6fd7fb3f3f] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:32:20.658783 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:20.659260 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:20.747432 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] [instance: 0bd2e22c-e10d-4a18-aeb0-9a6fd7fb3f3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:32:20.749000 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:20.749414 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:21.088352 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:21.088771 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:21.099449 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] [instance: 0fecd9cd-fe7a-4b0f-aa6c-cd0db8c621bf] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:32:21.100375 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:21.100986 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:21.324162 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] [instance: 0fecd9cd-fe7a-4b0f-aa6c-cd0db8c621bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:32:21.325494 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:21.325913 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:21.699530 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:21.700210 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f308ea0-b313-4dd5-9a43-8811b14a4eb4 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:34.069529 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:32:34.126471 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:34.127255 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:34.319930 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:34.320694 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:34.321749 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:34.322502 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:34.342328 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Getting quotas for project fca2528af41f4b8b81b14220881e7952. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:32:34.347240 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Getting quotas for user ac73e71796404757beeef52e3b221ca3 and project fca2528af41f4b8b81b14220881e7952. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:32:34.358965 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] [instance: 707fc046-c96e-4aae-bf83-40b3f327e3f7] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:32:34.360462 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:34.360974 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:34.452083 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] [instance: 707fc046-c96e-4aae-bf83-40b3f327e3f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:32:34.453866 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:34.454277 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:34.779529 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:34.779967 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8d60e6a2-bf13-4da2-91d0-c0790ff9e091 tempest-FloatingIPsAssociationTestJSON-213962761 tempest-FloatingIPsAssociationTestJSON-213962761-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:48.714417 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Took 0.57 seconds to select destinations for 2 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:32:48.761234 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:48.762355 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:48.908739 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:48.909051 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:49.076168 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:49.082089 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:49.083296 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:49.083707 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:49.120757 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Getting quotas for project bafb7288997e4bc9b8b916d808c6dfa9. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:32:49.131096 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Getting quotas for user 8c7a3219adb843548269f90ac2349c5d and project bafb7288997e4bc9b8b916d808c6dfa9. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:32:49.153485 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] [instance: 092b1782-1746-4ee1-ad0c-8cccf629b475] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:32:49.154502 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:49.154909 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:49.297501 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] [instance: 092b1782-1746-4ee1-ad0c-8cccf629b475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:32:49.299816 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:49.300526 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:49.617022 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:49.617425 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:49.628187 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] [instance: 21487c86-52b1-4b0e-a322-f0bc7495799a] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:32:49.629109 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:49.629911 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:49.766339 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] [instance: 21487c86-52b1-4b0e-a322-f0bc7495799a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:32:49.768530 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:49.769187 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:32:50.119758 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:32:50.121576 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8afaf47a-fe34-4785-b8ef-c7952496c2f1 tempest-MultipleCreateTestJSON-658362648 tempest-MultipleCreateTestJSON-658362648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:02.447495 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:33:02.485832 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:02.486342 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:02.650541 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:02.650947 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:02.655060 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:02.656026 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:02.681795 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Getting quotas for project 38ae6a1e9aaf4b188c2ba9392ceeb1a2. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:33:02.686643 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Getting quotas for user b4861956076e4376b029ec677a93bc97 and project 38ae6a1e9aaf4b188c2ba9392ceeb1a2. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:33:02.698241 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] [instance: 7ab0d13d-c194-4cbc-a5e2-9891976fc6df] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:33:02.699769 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:02.700174 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:02.753959 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] [instance: 7ab0d13d-c194-4cbc-a5e2-9891976fc6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:33:02.755441 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:02.756009 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:03.001629 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:03.002172 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-eeb38cb5-5100-4569-8ea9-e67c7d6ddf3d tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:06.567026 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:33:06.589571 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:06.590001 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:06.832179 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:06.832706 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:06.833536 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:06.834115 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:06.892834 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Getting quotas for project 94cb583cf9ad4b54b7715676e1f2d9e5. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:33:06.906383 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Getting quotas for user 52faf42b29f74c8d9b19316bf9c99f84 and project 94cb583cf9ad4b54b7715676e1f2d9e5. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:33:06.942683 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] [instance: 301271d7-dfaf-42a1-9def-930db3006f9f] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:33:06.949601 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:06.950904 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:07.045032 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] [instance: 301271d7-dfaf-42a1-9def-930db3006f9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:33:07.046565 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:07.047495 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:07.338073 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:07.338716 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9b9b537e-e75a-4baa-b719-573e80783e97 tempest-InstanceActionsTestJSON-1312569894 tempest-InstanceActionsTestJSON-1312569894-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:10.922043 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:33:22.584756 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:33:22.623897 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:22.624406 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:22.866473 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:22.866878 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:22.867593 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:22.867989 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:22.882959 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Getting quotas for project 38ae6a1e9aaf4b188c2ba9392ceeb1a2. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:33:22.887553 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Getting quotas for user b4861956076e4376b029ec677a93bc97 and project 38ae6a1e9aaf4b188c2ba9392ceeb1a2. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:33:22.897834 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] [instance: 2dc61637-1551-491d-97a5-1f260be3dbb1] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:33:22.898750 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:22.899150 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:23.091427 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] [instance: 2dc61637-1551-491d-97a5-1f260be3dbb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:33:23.093237 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:23.093827 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:23.525083 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:23.525540 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5314bd31-b2cc-4d99-ad38-baec3be2d280 tempest-LiveMigrationNegativeTest-254054073 tempest-LiveMigrationNegativeTest-254054073-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:24.288924 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:33:24.976213 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:24.976627 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:25.526536 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:33:25.560578 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:25.561158 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:25.826634 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:25.827355 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:25.828404 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:25.829637 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:25.848183 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Getting quotas for project bd92619f9d294e06aa8ea4b0cc3d20fb. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:33:25.855914 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Getting quotas for user ad4aaad63e1f496292c658457cae0e7e and project bd92619f9d294e06aa8ea4b0cc3d20fb. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:33:25.872681 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] [instance: 3114b7b7-bfcd-4ad7-8cc1-b9658ca358ca] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:33:25.877897 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:25.879024 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:26.030314 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] [instance: 3114b7b7-bfcd-4ad7-8cc1-b9658ca358ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:33:26.032000 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:26.032508 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:26.477370 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:26.477370 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d472a792-34ed-40ca-83e0-0bd2a623d90f tempest-ServerGroupTestJSON-221700008 tempest-ServerGroupTestJSON-221700008-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:46.267265 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:33:46.330202 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:46.332393 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:46.629610 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:46.629758 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:46.631225 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:46.631675 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:46.648155 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:33:46.652814 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for user 624ffbabbc954e0d89799f0eb1ec5a6c and project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:33:46.671099 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: c571268e-196d-42aa-ac78-0b0ba6f601b2] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:33:46.683912 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:46.683912 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:46.786874 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: c571268e-196d-42aa-ac78-0b0ba6f601b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:33:46.788049 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:46.788448 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:47.131023 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:47.131446 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b109bffe-c679-4582-9e15-ee3c7b5b12c2 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:51.142379 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:33:51.169511 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:51.170170 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:51.476338 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:51.477022 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:51.478062 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:51.478788 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:51.497658 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Getting quotas for project a0c8b60506c0410cb8b8303a693dfc9c. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:33:51.504657 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Getting quotas for user f0d763c9c24e45d3a1773fb681a5a94f and project a0c8b60506c0410cb8b8303a693dfc9c. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:33:51.517855 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] [instance: 0027ff58-8811-41e9-9395-016d2a78c87c] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:33:51.518924 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:51.519391 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:51.648727 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] [instance: 0027ff58-8811-41e9-9395-016d2a78c87c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:33:51.653034 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:51.658932 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:52.256447 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:52.257042 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ced09c7b-f66b-43ae-b491-cd2578059183 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:52.851883 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:33:52.908001 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:52.908901 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:53.292464 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:53.293353 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:53.294796 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:53.295503 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:53.341073 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Getting quotas for project a3abc91ec68c43a7ab279940197e9bc1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:33:53.351858 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Getting quotas for user aabc3a0bc3104bb89b216e4aa4e433b1 and project a3abc91ec68c43a7ab279940197e9bc1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:33:53.376735 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] [instance: 4e1cc3e2-e581-43ec-83ed-2669d04910a8] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:33:53.377730 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:53.378141 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:53.489870 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] [instance: 4e1cc3e2-e581-43ec-83ed-2669d04910a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:33:53.491592 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:53.492238 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:53.925680 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:53.925680 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2049b9bd-37c2-46a6-9ae0-98c494dc7488 tempest-ServersTestFqdnHostnames-172604915 tempest-ServersTestFqdnHostnames-172604915-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:56.038826 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:33:56.058348 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:56.058794 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:56.381412 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:56.382026 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:56.382787 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:56.383181 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:56.430223 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Getting quotas for project 732b280828c64fa4ad1b29f79f009fd4. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:33:56.440755 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Getting quotas for user 38c79bbdedb94dfaa6d7484913e3b0af and project 732b280828c64fa4ad1b29f79f009fd4. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:33:56.466899 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] [instance: 7d4f6351-a5a5-4f86-a136-f652b4247a20] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:33:56.467933 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:56.468368 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:56.592106 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] [instance: 7d4f6351-a5a5-4f86-a136-f652b4247a20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:33:56.593363 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:56.593800 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:56.940276 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:33:56.940276 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-49786b4e-a523-46fc-85bb-8dfd80aa82e0 tempest-ServerMetadataNegativeTestJSON-1035823098 tempest-ServerMetadataNegativeTestJSON-1035823098-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:33:57.775780 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:33:58.070226 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:33:58.798105 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38210. Aug 27 02:33:59.119864 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38218. Aug 27 02:34:06.967049 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:34:06.986607 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:06.987017 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:07.160962 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:07.163070 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:07.163841 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:07.164239 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:07.203413 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:34:07.208341 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for user 624ffbabbc954e0d89799f0eb1ec5a6c and project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:34:07.224501 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: bfb1ffbc-6716-4fc3-b1e6-6e57b2a51ea2] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:34:07.226455 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:07.226924 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:07.294282 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: bfb1ffbc-6716-4fc3-b1e6-6e57b2a51ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:34:07.297219 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:07.297219 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:07.437581 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:07.439098 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:07.754887 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:07.755207 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-372ad684-f16b-4922-bfc2-9b632bdb9cab tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:08.945788 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:34:09.000996 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:09.000996 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:09.256692 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:09.257833 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:09.258718 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:09.259615 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:09.275907 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Getting quotas for project 1a493f6b9ddb4fc3b9a2f305c222fb15. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:34:09.280571 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Getting quotas for user f65256860ae04893bfb0c413fac149ca and project 1a493f6b9ddb4fc3b9a2f305c222fb15. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:34:09.293697 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] [instance: 7c1bff56-eafb-443b-abb6-8a0dada0fc27] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:34:09.295361 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:09.295663 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:09.374518 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] [instance: 7c1bff56-eafb-443b-abb6-8a0dada0fc27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:34:09.376037 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:09.376457 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:09.714336 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:09.714688 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-831c5f46-1c47-446e-a09b-7ef6cec03993 tempest-ServerDiagnosticsNegativeTest-1722725555 tempest-ServerDiagnosticsNegativeTest-1722725555-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:10.061951 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:34:10.089614 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:10.089614 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:10.252890 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:10.261436 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:10.261436 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:10.261436 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:10.276310 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:34:10.293378 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for user 624ffbabbc954e0d89799f0eb1ec5a6c and project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:34:10.307524 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: 8e023fae-74a6-402b-aa84-fcd59d47406c] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:34:10.310095 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:10.310095 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:10.392880 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: 8e023fae-74a6-402b-aa84-fcd59d47406c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:34:10.392880 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:10.393554 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:10.685095 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:10.685720 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2a53c40e-b5d7-4acd-b42a-67408c1c0a25 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:24.211585 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:34:24.252623 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:24.256824 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:24.562205 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:24.564599 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:24.565606 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:24.567297 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:24.588657 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Getting quotas for project d73d13e0fe5b4e2b91ad1b52d2bba0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:34:24.594650 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Getting quotas for user 50f1bbec8fea40cf9c0b80864e8e62ca and project d73d13e0fe5b4e2b91ad1b52d2bba0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:34:24.608197 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: dd83c24a-bbd0-4732-8233-9c310976ff0c] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:34:24.612838 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:24.612838 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:24.776409 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: dd83c24a-bbd0-4732-8233-9c310976ff0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:34:24.778284 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:24.778697 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:25.308026 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:25.308601 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fb4ae28-a856-44f4-8131-bf7d753d0e67 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:34.831056 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:34:34.875028 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:34.875438 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:35.144027 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:35.144319 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:35.145255 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:35.146010 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:35.167283 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Getting quotas for project a0c8b60506c0410cb8b8303a693dfc9c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:34:35.173825 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Getting quotas for user f0d763c9c24e45d3a1773fb681a5a94f and project a0c8b60506c0410cb8b8303a693dfc9c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:34:35.190020 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] [instance: 7d26320a-e74e-45ed-900b-8152fe0b189e] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:34:35.191248 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:35.191845 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:35.312130 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] [instance: 7d26320a-e74e-45ed-900b-8152fe0b189e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:34:35.313981 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:35.314550 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:35.792562 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:35.793300 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-51b60578-02df-473c-b50d-9ec2438fed07 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:39.086312 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:34:39.141080 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:39.144901 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:39.467580 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:39.470083 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:39.471255 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:39.473971 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:39.507375 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:34:39.513035 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for user 624ffbabbc954e0d89799f0eb1ec5a6c and project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:34:39.533222 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: d10fd70f-804e-41f9-86d2-f03674fc4581] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:34:39.535245 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:39.541989 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:39.671778 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: d10fd70f-804e-41f9-86d2-f03674fc4581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:34:39.674419 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:39.675228 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:40.202964 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:40.202964 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7985660f-28be-4835-8a80-f09021f68ede tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:47.024727 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:34:47.025346 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:47.027029 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:47.785985 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: dd83c24a-bbd0-4732-8233-9c310976ff0c] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101511) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 02:34:48.371061 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Created allocations for migration 238445b6-0430-4cee-9a69-21ddd1a4a6cb on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101511) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:34:48.670451 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: dd83c24a-bbd0-4732-8233-9c310976ff0c] Calling prep_resize with selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [Selection(allocation_request='{"allocations": {"8f1d7267-4d7c-4650-83e0-62766d0c0a07": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8f1d7267-4d7c-4650-83e0-62766d0c0a07"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=d68f2037-da7b-424a-bde4-8ae09fc2781e,compute_node_uuid=8f1d7267-4d7c-4650-83e0-62766d0c0a07,limits=SchedulerLimits,nodename='n-h2-802225-4',service_host='n-h2-802225-4')] {{(pid=101511) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 02:34:48.939329 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.client.report [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Overwriting current allocation {'allocations': {'6e12de08-5d57-48b3-b442-9a192ba4e475': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 57}}, 'project_id': 'd73d13e0fe5b4e2b91ad1b52d2bba0e0', 'user_id': '50f1bbec8fea40cf9c0b80864e8e62ca', 'consumer_generation': 1} on consumer dd83c24a-bbd0-4732-8233-9c310976ff0c {{(pid=101511) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 02:34:49.090524 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Created allocations for instance dd83c24a-bbd0-4732-8233-9c310976ff0c on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101511) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 02:34:49.183109 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.utils [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:34:49.184617 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.utils [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: dd83c24a-bbd0-4732-8233-9c310976ff0c] Setting instance to ACTIVE state. Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server [None req-b1b6c55b-3e80-47e4-ac5f-4bfd53b0212b tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 02:34:49.609612 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 02:34:49.618696 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 02:34:49.620317 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:34:49.620317 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Aug 27 02:34:51.246788 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:34:51.266329 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:51.266817 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:51.470756 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:51.471289 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:51.472064 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:51.472453 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:51.490766 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Getting quotas for project 00de34bcf509468c8ffff8830579a367. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:34:51.495958 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Getting quotas for user 76f4898f157e4c579015b41676c5b455 and project 00de34bcf509468c8ffff8830579a367. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:34:51.508816 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] [instance: 50c5f5c4-a36d-4ed5-b193-1088969f76a7] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:34:51.509795 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:51.510207 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:51.579356 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] [instance: 50c5f5c4-a36d-4ed5-b193-1088969f76a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:34:51.580603 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:51.581072 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:34:51.924338 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:34:51.926123 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-da1fdd98-d7fb-4563-895b-9ba44be8f45c tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:05.760956 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:35:05.790926 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:05.791333 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:05.943791 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:05.944049 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:05.944627 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:05.945217 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:05.968084 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:35:05.973276 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for user 624ffbabbc954e0d89799f0eb1ec5a6c and project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:35:05.996591 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: 8721f623-3d6a-4173-9d54-62f8305034a7] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:35:05.997592 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:05.998142 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:06.098421 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: 8721f623-3d6a-4173-9d54-62f8305034a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:35:06.099823 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:06.100237 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:06.425669 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:06.426123 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7e94629-f38f-48a3-bac5-a2c253fcec64 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:19.778008 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:35:19.796734 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:19.797148 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:19.986104 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:19.986583 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:19.987373 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:19.987837 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:20.002668 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:35:20.007783 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for user 624ffbabbc954e0d89799f0eb1ec5a6c and project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:35:20.018632 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: d98cd15b-004b-4567-b2c2-f6966ea7d698] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:35:20.019592 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:20.020003 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:20.080585 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: d98cd15b-004b-4567-b2c2-f6966ea7d698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:35:20.081873 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:20.082472 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:20.420626 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:20.421705 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-780a0e9a-6629-4cde-b6a2-cb42cfb3a0ae tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:34.070265 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:35:34.120753 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:34.121489 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:34.411058 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:34.416285 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:34.416285 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:34.416285 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:34.481312 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Getting quotas for project c1b39a4d3114426f847ba474c13dac9c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:35:34.502899 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Getting quotas for user 9424cb753193482d8ca1f9a2391579ba and project c1b39a4d3114426f847ba474c13dac9c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:35:34.531635 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] [instance: d1f7110b-eb06-4376-bf48-064685668081] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:35:34.532875 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:34.533567 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:34.606863 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] [instance: d1f7110b-eb06-4376-bf48-064685668081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:35:34.612918 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:34.612918 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:34.925865 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:34.926485 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a11f0629-20e7-4e5c-bd74-786ab489755e tempest-ImagesOneServerTestJSON-1428603362 tempest-ImagesOneServerTestJSON-1428603362-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:43.629574 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:35:43.648527 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:43.648943 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:43.824201 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:43.825018 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:43.826091 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:43.826642 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:43.845851 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Getting quotas for project a0c8b60506c0410cb8b8303a693dfc9c. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:35:43.851651 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Getting quotas for user f0d763c9c24e45d3a1773fb681a5a94f and project a0c8b60506c0410cb8b8303a693dfc9c. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:35:43.866843 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] [instance: c6cedae3-787f-48db-9ca6-83ddd3840da0] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:35:43.868042 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:43.868626 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:43.968090 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] [instance: c6cedae3-787f-48db-9ca6-83ddd3840da0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:35:43.970243 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:43.971863 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:44.538227 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:44.543233 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-01862c69-47fb-4cf7-8f18-e5803d070124 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:51.905921 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:35:51.931321 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:51.932101 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:52.186164 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:52.186164 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:52.186164 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:52.186610 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:52.219443 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:35:52.225482 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for user 624ffbabbc954e0d89799f0eb1ec5a6c and project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:35:52.239371 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: 53818202-3a35-4a7d-ac40-df081f94386a] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:35:52.242445 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:52.242445 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:52.331220 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: 53818202-3a35-4a7d-ac40-df081f94386a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:35:52.332646 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:52.334204 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:35:52.660960 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:35:52.661547 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-681b5315-1f30-4620-aaf7-d3213cbcd525 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:09.434227 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:36:09.452801 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:09.455557 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:09.920339 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:09.921033 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:09.921958 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:09.922526 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:09.943951 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Getting quotas for project 7140ca4cb7bd449c8b06908260e8c71d. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:36:09.949289 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Getting quotas for user 4ab1efe018c94c49b60fad0bdb85c20c and project 7140ca4cb7bd449c8b06908260e8c71d. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:36:09.961991 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] [instance: f949cbe0-a2b7-4a89-9203-9ecbd94901dd] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:36:09.962931 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:09.963329 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:10.084337 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] [instance: f949cbe0-a2b7-4a89-9203-9ecbd94901dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:36:10.086252 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:10.086252 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:10.556338 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:10.557005 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad7c31e7-8e71-4bfd-9cbe-2ee91e39adca tempest-ServerAddressesNegativeTestJSON-207727712 tempest-ServerAddressesNegativeTestJSON-207727712-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:11.203683 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:36:11.222640 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:11.223046 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:11.476183 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:11.476666 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:11.478106 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:11.478644 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:11.496003 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Getting quotas for project ba4e652e6a264feca2ce3eb6fc7373e9. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:36:11.502186 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Getting quotas for user c47b0f86becc499e8e095f4c16185137 and project ba4e652e6a264feca2ce3eb6fc7373e9. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:36:11.517892 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] [instance: 75cb8a79-bb1d-4f06-b20f-24af11c6a592] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:36:11.518955 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:11.519466 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:11.611088 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] [instance: 75cb8a79-bb1d-4f06-b20f-24af11c6a592] block_device_mapping [BlockDeviceMapping(attachment_id=6c4903b1-8f92-459c-a0b1-55f38317000b,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aeb12c4e-c248-4d2c-8ae9-e9ee92c23d71',volume_size=1,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:36:11.612319 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:11.612769 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:11.874298 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:11.874703 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ae1e09c1-63df-4a8e-9013-d4aa7cba0046 tempest-ServersTestBootFromVolume-325861096 tempest-ServersTestBootFromVolume-325861096-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:14.359932 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:36:14.384851 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:14.385559 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:14.677184 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:14.677906 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:14.679942 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:14.680945 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:14.708774 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:36:14.715772 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Getting quotas for user 624ffbabbc954e0d89799f0eb1ec5a6c and project 5116a27a584d4e1cbbe7119a7170c645. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:36:14.730208 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: 90ca74c3-ce31-42a9-a337-14f6fb51b713] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:36:14.731541 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:14.732417 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:14.881005 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] [instance: 90ca74c3-ce31-42a9-a337-14f6fb51b713] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:36:14.882572 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:14.884550 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:15.231235 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:15.231919 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8fd80878-0a7e-437c-aa10-8075601aeb84 tempest-ServersTestJSON-529972016 tempest-ServersTestJSON-529972016-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:33.443598 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:36:33.463299 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:33.463709 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:33.658996 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:33.659334 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:33.660041 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:33.660432 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:33.675320 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Getting quotas for project a0c8b60506c0410cb8b8303a693dfc9c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:36:33.680274 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Getting quotas for user f0d763c9c24e45d3a1773fb681a5a94f and project a0c8b60506c0410cb8b8303a693dfc9c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:36:33.690341 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] [instance: 05eba736-0aff-442a-870b-6c97c61b6f38] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:36:33.691214 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:33.691617 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:33.953583 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] [instance: 05eba736-0aff-442a-870b-6c97c61b6f38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:36:33.953583 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:33.953583 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:34.256923 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:34.257333 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a7a45460-6825-4511-b7b9-b89cfa2b10b6 tempest-ImagesTestJSON-1420790706 tempest-ImagesTestJSON-1420790706-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:44.309103 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:36:50.520658 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:36:50.542509 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:50.542915 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:50.786846 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:50.787469 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:50.789196 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:50.790218 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:50.808654 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Getting quotas for project 513dfee87c4b4bd19fc2c779bb3a7a57. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:36:50.813896 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Getting quotas for user a81bf46dbdc1411a93782458b111cc3c and project 513dfee87c4b4bd19fc2c779bb3a7a57. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:36:50.825200 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] [instance: c3bf5a7f-6f3e-48fc-9b06-94c00b68dc43] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:36:50.826417 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:50.826999 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:50.931550 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] [instance: c3bf5a7f-6f3e-48fc-9b06-94c00b68dc43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:36:50.931550 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:50.931897 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:51.111922 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:36:51.146487 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:51.147140 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:51.215764 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:51.216158 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1a38b6e4-e484-48c0-997c-fa287123f5c5 tempest-InstanceActionsV221TestJSON-1251441279 tempest-InstanceActionsV221TestJSON-1251441279-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:51.426672 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:51.427366 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:51.428097 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:51.428491 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:51.445283 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Getting quotas for project 45eaf321e7024d1884506319e99d212a. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:36:51.450399 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Getting quotas for user 3a0eb1218dc94acbbd79167e311e5cd4 and project 45eaf321e7024d1884506319e99d212a. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:36:51.463549 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] [instance: 51ebceb8-65bd-48dc-aa34-7d8886a85d0e] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:36:51.464725 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:51.465293 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:51.548539 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] [instance: 51ebceb8-65bd-48dc-aa34-7d8886a85d0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:36:51.549845 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:51.550250 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:51.851571 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:51.852285 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-118aa175-0409-4c54-ae4a-cad626d248dd tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:52.617250 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:36:52.635791 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:52.636138 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:52.747816 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:52.748437 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:52.749641 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:52.750223 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:52.769269 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Getting quotas for project 45eaf321e7024d1884506319e99d212a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:36:52.785350 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Getting quotas for user 3a0eb1218dc94acbbd79167e311e5cd4 and project 45eaf321e7024d1884506319e99d212a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:36:52.799848 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] [instance: a6f79731-04cc-48b2-8c74-1bf886a12788] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:36:52.800818 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:52.801198 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:52.936743 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] [instance: a6f79731-04cc-48b2-8c74-1bf886a12788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:36:52.938047 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:52.938456 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:53.438720 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:53.439882 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9f73ac32-7ef3-410b-8f36-865b86ed29a3 tempest-ServerRescueNegativeTestJSON-2012802119 tempest-ServerRescueNegativeTestJSON-2012802119-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:58.798300 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:36:59.117491 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:36:59.770107 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:36:59.790296 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:36:59.790752 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:36:59.814419 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43188. Aug 27 02:37:00.102098 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:00.102532 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:00.103283 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:00.103680 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:00.119583 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Getting quotas for project 0c75b5595bd54391b0ac29aee0919a22. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:37:00.124082 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Getting quotas for user 7f313c9c419943e7ae24674e167a2100 and project 0c75b5595bd54391b0ac29aee0919a22. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:37:00.135389 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] [instance: e15eb2e7-eda5-4187-ad35-092b33dd7c63] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:37:00.135903 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43194. Aug 27 02:37:00.136419 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:00.136766 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:00.208115 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] [instance: e15eb2e7-eda5-4187-ad35-092b33dd7c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:37:00.209532 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:00.209940 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:00.575992 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:00.576430 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4db5c9c-5d91-4c80-bf89-988764c25ac9 tempest-ImagesNegativeTestJSON-1832784464 tempest-ImagesNegativeTestJSON-1832784464-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:13.821497 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Took 0.80 seconds to select destinations for 3 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:37:13.841512 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:13.842051 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:14.032443 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:14.032845 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:14.262369 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:14.262781 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:14.404626 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:14.405148 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:14.406633 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:14.407033 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:14.425164 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Getting quotas for project 48d8db64d5b843b9b703571168602d02. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:37:14.430684 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Getting quotas for user 3fce3adfa4bf4fe89de054d6106ef73a and project 48d8db64d5b843b9b703571168602d02. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:37:14.444815 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] [instance: 0a84b30a-90f8-41e0-b3c0-d6414b365e41] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:37:14.445760 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:14.446483 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:14.527449 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] [instance: 0a84b30a-90f8-41e0-b3c0-d6414b365e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:37:14.528964 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:14.529399 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:14.840373 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:14.841012 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:14.850720 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] [instance: dd0ef22f-cc29-4558-8c00-b4c398b00a80] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:37:14.851570 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:14.851971 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:14.999163 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] [instance: dd0ef22f-cc29-4558-8c00-b4c398b00a80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:37:15.004448 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:15.004448 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:15.377939 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:15.378357 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:15.395973 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] [instance: cf441925-3a20-49a3-9496-6e28151968b2] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:37:15.398163 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:15.399031 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:15.504402 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] [instance: cf441925-3a20-49a3-9496-6e28151968b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:37:15.505783 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:15.506208 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:15.826258 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:15.826825 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aa22b13e-edf8-464d-a669-cec56eb7632a tempest-ListServersNegativeTestJSON-1958130798 tempest-ListServersNegativeTestJSON-1958130798-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:16.173408 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:37:16.213884 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:16.214295 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:16.453489 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:16.455031 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:16.455528 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:16.456308 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:16.480920 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Getting quotas for project 88e20ed079114c4d80500d33cc473d05. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:37:16.486136 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Getting quotas for user 877bc27777da4d61ad1785fc77558966 and project 88e20ed079114c4d80500d33cc473d05. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:37:16.501524 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] [instance: e285988f-7a3c-4cb1-bdbf-2155aadd0041] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:37:16.502524 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:16.502931 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:16.617321 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] [instance: e285988f-7a3c-4cb1-bdbf-2155aadd0041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:37:16.618605 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:16.619157 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:16.917188 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:16.917888 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06e75cf3-e190-4d82-93e7-b985487d7b8c tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:22.457086 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-fa871e6c-898f-423c-9c5a-df79e7c64fd3 tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method rebuild_instance {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:37:22.457693 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fa871e6c-898f-423c-9c5a-df79e7c64fd3 tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:22.461556 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fa871e6c-898f-423c-9c5a-df79e7c64fd3 tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:22.566400 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-fa871e6c-898f-423c-9c5a-df79e7c64fd3 tempest-ServerShowV257Test-1664655231 tempest-ServerShowV257Test-1664655231-project] [instance: e285988f-7a3c-4cb1-bdbf-2155aadd0041] No migration record for the rebuild/evacuate request. {{(pid=101512) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Aug 27 02:37:29.648303 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:37:29.672250 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:29.672936 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:29.871846 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:29.872260 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:29.872990 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:29.873621 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:29.889991 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Getting quotas for project 54bc1d7a1dab404985a38f65ded6190a. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:37:29.894439 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Getting quotas for user eca376f4fe5d43bf84df95de1a0596f3 and project 54bc1d7a1dab404985a38f65ded6190a. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:37:29.905683 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] [instance: 8e8e14b3-6c94-42fa-81e1-a6702d02ac4c] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:37:29.906621 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:29.907033 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:30.070160 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] [instance: 8e8e14b3-6c94-42fa-81e1-a6702d02ac4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:37:30.071431 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:30.071834 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:30.425246 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:30.425616 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-80b511d8-474c-45e0-ac14-8df325e097ad tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:54.531502 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:37:54.550754 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:54.551123 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:54.757236 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:54.757677 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:54.758402 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:54.758796 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:54.773682 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Getting quotas for project c23fbe1eddf747eea8590d58aabc7842. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:37:54.778102 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Getting quotas for user 4d8b3c717c8c4594b180a58ab32b15a0 and project c23fbe1eddf747eea8590d58aabc7842. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:37:54.788576 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] [instance: a8dec6fb-0667-45f1-9d10-d6c8aa438421] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:37:54.789544 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:54.789949 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:55.026583 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] [instance: a8dec6fb-0667-45f1-9d10-d6c8aa438421] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:37:55.026583 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:55.026583 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:55.543916 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:55.544442 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6b741708-6e68-4e59-b0c5-a99a97141f85 tempest-ServersNegativeTestMultiTenantJSON-1714094615 tempest-ServersNegativeTestMultiTenantJSON-1714094615-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:56.604626 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:37:56.622743 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:56.623153 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:56.740532 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:56.740947 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:56.741774 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:56.742185 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:56.757354 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Getting quotas for project 54bc1d7a1dab404985a38f65ded6190a. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:37:56.762576 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Getting quotas for user eca376f4fe5d43bf84df95de1a0596f3 and project 54bc1d7a1dab404985a38f65ded6190a. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:37:56.773318 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] [instance: 320a70f1-07cb-4c57-9945-e7da8c47a541] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:37:56.774287 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:56.774729 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:56.845799 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] [instance: 320a70f1-07cb-4c57-9945-e7da8c47a541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:37:56.847074 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:56.847555 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:37:57.339642 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:37:57.340246 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-efe705c7-2d78-471c-9d42-ccd796701c29 tempest-SecurityGroupsTestJSON-1315836501 tempest-SecurityGroupsTestJSON-1315836501-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:24.910030 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:38:24.941212 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:24.944290 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:25.252501 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:25.253376 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:25.256769 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:25.257393 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:25.293574 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Getting quotas for project c9eb7ba08d854864b6e2d1a7091737fb. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:38:25.299191 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Getting quotas for user 88cf026f8f364e87bdcc2b9eb8937d76 and project c9eb7ba08d854864b6e2d1a7091737fb. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:38:25.313933 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] [instance: 58100f48-cfe8-4cf7-982a-2df45252d032] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:38:25.315192 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:25.315769 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:25.404953 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] [instance: 58100f48-cfe8-4cf7-982a-2df45252d032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:38:25.407021 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:25.408122 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:25.755168 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:25.755908 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-73c216aa-dbcf-4816-9fae-cc2ba91d0aac tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:38.367051 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8ef87836-513a-47e4-a3a7-39d49d5b47d7 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method unshelve_instance {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:38:38.373566 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8ef87836-513a-47e4-a3a7-39d49d5b47d7 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:38.378354 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8ef87836-513a-47e4-a3a7-39d49d5b47d7 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:39.277673 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8ef87836-513a-47e4-a3a7-39d49d5b47d7 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] [instance: 50c5f5c4-a36d-4ed5-b193-1088969f76a7] Requesting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) during scheduling {{(pid=101511) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:930}} Aug 27 02:38:39.671832 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8ef87836-513a-47e4-a3a7-39d49d5b47d7 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:38:39.679911 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-8ef87836-513a-47e4-a3a7-39d49d5b47d7 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lazy-loading 'flavor' on Instance uuid 50c5f5c4-a36d-4ed5-b193-1088969f76a7 {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:38:51.974124 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:38:52.010617 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:52.011515 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:52.254355 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:52.260753 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:52.260753 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:52.260753 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:52.274113 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Getting quotas for project f3e6f4c70d334917a843d594538e9ccf. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:38:52.279959 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Getting quotas for user d67ccf35df7340f28af12cb1c28f6658 and project f3e6f4c70d334917a843d594538e9ccf. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:38:52.298991 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] [instance: e5017061-8d95-4680-bbbb-c83a0a11d6b0] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:38:52.300445 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:52.301060 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:52.369929 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] [instance: e5017061-8d95-4680-bbbb-c83a0a11d6b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:38:52.371399 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:52.372001 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:38:52.691595 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:38:52.692214 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-23468284-61dd-4cb6-99dc-9432f0a5dd4d tempest-ServersTestJSON-1700048142 tempest-ServersTestJSON-1700048142-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:39:50.345624 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:39:50.364954 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:39:50.365364 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:39:50.555250 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:39:50.555665 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:39:50.556403 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:39:50.556811 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:39:50.571670 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Getting quotas for project a7426cd217d447deb9f2ff71da1bccdd. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:39:50.576155 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Getting quotas for user fd7360158dd1435c971b661cd1219e87 and project a7426cd217d447deb9f2ff71da1bccdd. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:39:50.587126 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] [instance: e0a2f1f4-74ba-4375-b931-6f1b3f7ba430] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:39:50.588010 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:39:50.588689 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:39:50.695500 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] [instance: e0a2f1f4-74ba-4375-b931-6f1b3f7ba430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:39:50.697421 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:39:50.698033 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:39:50.901580 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:39:50.902612 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ea998919-dd08-49ff-8255-e6d5c008cb2a tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:39:50.947355 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:39:59.815895 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:40:00.136690 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:40:00.837367 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47618. Aug 27 02:40:01.158237 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47634. Aug 27 02:40:04.325822 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:40:09.286888 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:40:09.307972 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:09.312025 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:09.423942 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:09.424359 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:09.425215 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:09.425653 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:09.455019 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Getting quotas for project 00de34bcf509468c8ffff8830579a367. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:40:09.462961 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Getting quotas for user 76f4898f157e4c579015b41676c5b455 and project 00de34bcf509468c8ffff8830579a367. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:40:09.476340 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] [instance: 07648bc0-eff7-4e20-93bb-e951c9a582e2] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:40:09.477644 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:09.478199 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:09.532459 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] [instance: 07648bc0-eff7-4e20-93bb-e951c9a582e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:40:09.533813 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:09.537325 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:09.831727 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:09.842706 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ae292d57-ab65-433b-9eba-41b25ca513a6 tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:48.938894 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:40:48.959305 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:48.960205 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:49.109103 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:49.109786 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:49.110606 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:49.111095 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:49.138117 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Getting quotas for project d73d13e0fe5b4e2b91ad1b52d2bba0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:40:49.144685 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Getting quotas for user 50f1bbec8fea40cf9c0b80864e8e62ca and project d73d13e0fe5b4e2b91ad1b52d2bba0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:40:49.157981 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: 7e9e2fef-a5df-430a-87ed-38f1139c9267] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:40:49.159071 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:49.159573 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:49.234496 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: 7e9e2fef-a5df-430a-87ed-38f1139c9267] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:40:49.235745 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:49.236147 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:40:49.493332 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:40:49.493854 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-646af1cf-e37c-4b51-914c-329883f48b49 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:06.065049 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:41:06.071919 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:06.072652 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:06.845009 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: 7e9e2fef-a5df-430a-87ed-38f1139c9267] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101512) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 02:41:07.580229 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Created allocations for migration 49af5dba-245c-467c-8820-747cb19c257d on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:41:07.968937 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: 7e9e2fef-a5df-430a-87ed-38f1139c9267] Calling prep_resize with selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [Selection(allocation_request='{"allocations": {"6e12de08-5d57-48b3-b442-9a192ba4e475": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["6e12de08-5d57-48b3-b442-9a192ba4e475"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=d68f2037-da7b-424a-bde4-8ae09fc2781e,compute_node_uuid=6e12de08-5d57-48b3-b442-9a192ba4e475,limits=SchedulerLimits,nodename='n-h1-802225-4',service_host='n-h1-802225-4')] {{(pid=101512) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 02:41:08.471831 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.client.report [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Overwriting current allocation {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 108}}, 'project_id': 'd73d13e0fe5b4e2b91ad1b52d2bba0e0', 'user_id': '50f1bbec8fea40cf9c0b80864e8e62ca', 'consumer_generation': 1} on consumer 7e9e2fef-a5df-430a-87ed-38f1139c9267 {{(pid=101512) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 02:41:08.682640 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Created allocations for instance 7e9e2fef-a5df-430a-87ed-38f1139c9267 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 02:41:08.825480 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:41:08.826900 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: 7e9e2fef-a5df-430a-87ed-38f1139c9267] Setting instance to ACTIVE state. Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server [None req-6be02e08-1518-4894-9c8d-cffcb68300a9 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 02:41:09.315426 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 02:41:09.316610 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 02:41:09.328856 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:41:09.328856 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Aug 27 02:41:20.028972 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:41:20.047842 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:20.048301 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:20.295352 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:20.296011 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:20.297641 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:20.298216 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:20.317999 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:41:20.322869 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for user 91cf2d10bb46463db824705c4ea8f191 and project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:41:20.334902 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: aebef2d4-0ae1-43ff-898d-05821c7becb3] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:41:20.336399 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:20.348376 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:20.449091 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: aebef2d4-0ae1-43ff-898d-05821c7becb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:41:20.450711 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:20.451189 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:20.707799 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:20.708213 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f223227f-0adf-4968-874e-63c6f8294c40 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:40.008599 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:41:40.043156 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:40.043689 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:40.191020 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:40.191432 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:40.192351 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:40.192848 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:40.207233 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:41:40.212099 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for user 91cf2d10bb46463db824705c4ea8f191 and project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:41:40.222579 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: b06d11b7-8560-482c-baa5-05b9d2500f13] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:41:40.224021 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:40.224426 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:40.296391 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: b06d11b7-8560-482c-baa5-05b9d2500f13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:41:40.297723 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:40.298134 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:40.570207 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:40.573042 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-31faf2dd-7d3b-4989-a1f9-f5e38d488484 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:54.585860 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:41:54.611171 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:54.611678 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:54.889279 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:54.889712 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:54.890632 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:54.891019 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:54.909698 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Getting quotas for project 32e2d77336a74c5a970c376cea34e606. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:41:54.914360 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Getting quotas for user f8e0ea1278d94a74b71111ed3c1071d7 and project 32e2d77336a74c5a970c376cea34e606. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:41:54.926829 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] [instance: 93e087ea-13a9-462d-b94f-d24e81073a6c] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:41:54.927819 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:54.928226 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:55.033695 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] [instance: 93e087ea-13a9-462d-b94f-d24e81073a6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:41:55.034978 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:55.035402 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:41:55.366957 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:41:55.367368 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8a15c51d-342c-4840-b98d-1c03297b9992 tempest-InstanceActionsNegativeTestJSON-589431466 tempest-InstanceActionsNegativeTestJSON-589431466-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:23.762712 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Took 2.71 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:42:23.803927 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:23.804731 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:24.030564 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:24.030980 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:24.031722 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:24.032130 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:24.080235 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Getting quotas for project 007c7d55d37f49eca2a6a09b5f407b77. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:42:24.091988 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Getting quotas for user 103b96669f2c40f29285115556755d15 and project 007c7d55d37f49eca2a6a09b5f407b77. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:42:24.106214 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] [instance: 6d35f79f-2061-490a-9f63-f9d96f079cc7] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:42:24.107601 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:24.108168 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:24.183620 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] [instance: 6d35f79f-2061-490a-9f63-f9d96f079cc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:42:24.185292 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:24.186501 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:24.423153 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:24.423931 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-aaa48524-cef5-4c17-9743-7b927e75420c tempest-ServerPasswordTestJSON-957316308 tempest-ServerPasswordTestJSON-957316308-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:25.549999 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-cf4d3139-6d7d-4fc5-bb13-7ae8814b2dad tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:42:25.584870 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-cf4d3139-6d7d-4fc5-bb13-7ae8814b2dad tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: 77832ff4-0c09-4602-9158-39b028af5350] While scheduling instance, the build request was already deleted. {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1600}} Aug 27 02:42:26.334815 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.client.report [None req-cf4d3139-6d7d-4fc5-bb13-7ae8814b2dad tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Unable to delete allocation for instance 77832ff4-0c09-4602-9158-39b028af5350: (409 {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Inventory and/or allocations changed while attempting to allocate: Another thread concurrently updated the resource provider data. Please retry your update ", "code": "placement.concurrent_update", "request_id": "req-3d886bff-242a-4d52-8d0c-449c51d47eae"}]}): nova.exception.BuildRequestNotFound: BuildRequest not found for instance 77832ff4-0c09-4602-9158-39b028af5350 Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server [None req-cf4d3139-6d7d-4fc5-bb13-7ae8814b2dad tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Exception during message handling: nova.exception.AllocationDeleteFailed: Failed to delete allocations for consumer 77832ff4-0c09-4602-9158-39b028af5350. Error: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Inventory and/or allocations changed while attempting to allocate: Another thread concurrently updated the resource provider data. Please retry your update ", "code": "placement.concurrent_update", "request_id": "req-3d886bff-242a-4d52-8d0c-449c51d47eae"}]} Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 1596, in schedule_and_build_instances Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server objects.BuildRequest.get_by_instance_uuid( Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server result = fn(cls, context, *args, **kwargs) Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 27 02:42:26.353382 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server nova.exception.BuildRequestNotFound: BuildRequest not found for instance 77832ff4-0c09-4602-9158-39b028af5350 Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 1613, in schedule_and_build_instances Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.report_client.delete_allocation_for_instance( Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/scheduler/client/report.py", line 73, in wrapper Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return f(self, *a, **k) Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/scheduler/client/report.py", line 2117, in delete_allocation_for_instance Aug 27 02:42:26.354313 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise exception.AllocationDeleteFailed(consumer_uuid=uuid, Aug 27 02:42:26.355282 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server nova.exception.AllocationDeleteFailed: Failed to delete allocations for consumer 77832ff4-0c09-4602-9158-39b028af5350. Error: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Inventory and/or allocations changed while attempting to allocate: Another thread concurrently updated the resource provider data. Please retry your update ", "code": "placement.concurrent_update", "request_id": "req-3d886bff-242a-4d52-8d0c-449c51d47eae"}]} Aug 27 02:42:26.355282 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Aug 27 02:42:27.794256 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:42:27.817935 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:27.818589 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:27.986191 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:27.986969 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:27.987901 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:27.988440 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:28.026674 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:42:28.032612 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for user 91cf2d10bb46463db824705c4ea8f191 and project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:42:28.047916 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: 9304a377-dbba-4ed5-bdb9-dd917d07ef61] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:42:28.047916 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:28.048152 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:28.194850 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: 9304a377-dbba-4ed5-bdb9-dd917d07ef61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:42:28.196111 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:28.196510 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:28.454400 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:28.454816 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b42e754d-6a2e-4a23-8796-4cc6b8073779 tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:43.402768 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9e06041e-a16b-474b-9ca9-61ea837a2d1d tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method unshelve_instance {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:42:43.405699 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9e06041e-a16b-474b-9ca9-61ea837a2d1d tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:42:43.406407 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9e06041e-a16b-474b-9ca9-61ea837a2d1d tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:42:43.897774 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9e06041e-a16b-474b-9ca9-61ea837a2d1d tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] [instance: 07648bc0-eff7-4e20-93bb-e951c9a582e2] Requesting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) during scheduling {{(pid=101511) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:930}} Aug 27 02:42:44.287480 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9e06041e-a16b-474b-9ca9-61ea837a2d1d tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:42:44.297155 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-9e06041e-a16b-474b-9ca9-61ea837a2d1d tempest-AttachVolumeShelveTestJSON-1340644031 tempest-AttachVolumeShelveTestJSON-1340644031-project] Lazy-loading 'flavor' on Instance uuid 07648bc0-eff7-4e20-93bb-e951c9a582e2 {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:43:00.836851 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 02:43:01.160902 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 02:43:01.864710 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52488. Aug 27 02:43:02.214001 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52494. Aug 27 02:43:02.371529 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:43:02.409822 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:02.410584 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:02.710532 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:02.711470 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:02.712849 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:02.714225 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:02.771975 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:43:02.781523 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for user 91cf2d10bb46463db824705c4ea8f191 and project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:43:02.843471 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: 45395a73-64d4-4cd0-b63d-4fcbf6ab4e4f] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:43:02.844520 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:02.848591 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:02.908682 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: 45395a73-64d4-4cd0-b63d-4fcbf6ab4e4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:43:02.910021 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:02.910428 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:03.219582 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:03.222743 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8660a715-0bb3-4e78-9e6f-06ca03b5ae7d tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:05.874692 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:43:05.914427 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:05.914886 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:06.167751 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:06.170291 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:06.174069 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:06.174719 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:06.230116 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Getting quotas for project c8897dd35f31441ba183d2142608a762. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:43:06.250417 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Getting quotas for user 64d90fcbf19c4a82afd329ab385255a6 and project c8897dd35f31441ba183d2142608a762. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:43:06.288787 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] [instance: 5009e9f9-e56d-449e-8a82-7ccbd9ca12ea] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:43:06.290212 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:06.290854 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:06.359026 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] [instance: 5009e9f9-e56d-449e-8a82-7ccbd9ca12ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:43:06.361365 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:06.361916 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:06.635797 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:43:06.645636 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9fdf0cc6-cebc-4a6e-820f-b199899cc1cf tempest-ServerRescueTestJSONUnderV235-1998513637 tempest-ServerRescueTestJSONUnderV235-1998513637-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:43:10.967598 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:44:25.629348 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:44:25.679988 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:25.680853 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:25.879667 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:25.880180 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:25.881874 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:25.882368 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:25.901009 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:44:25.907283 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for user 91cf2d10bb46463db824705c4ea8f191 and project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:44:25.922411 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: 4a970886-f0ee-460e-99bd-c138bf53f605] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:44:25.928449 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:25.928867 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:26.104486 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: 4a970886-f0ee-460e-99bd-c138bf53f605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:44:26.105938 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:26.106617 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:26.534245 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:26.534987 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-42b01647-7449-4033-b7c4-1c0e810f831c tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:34.254783 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:44:34.340093 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:34.346314 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:34.610580 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:34.612115 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:34.615663 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:34.616320 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:34.635669 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Getting quotas for project a7426cd217d447deb9f2ff71da1bccdd. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:44:34.641679 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Getting quotas for user fd7360158dd1435c971b661cd1219e87 and project a7426cd217d447deb9f2ff71da1bccdd. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:44:34.654516 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] [instance: 966185cb-9c1a-4e6a-bbe9-ab47cefd8c41] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:44:34.655833 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:34.656508 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:34.732749 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] [instance: 966185cb-9c1a-4e6a-bbe9-ab47cefd8c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:44:34.734491 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:34.735064 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:34.974295 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:34.975072 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2ac81d8d-b54d-4eb5-9488-07e39c88739d tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:41.489656 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:44:41.559052 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:41.559490 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:41.754018 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:41.754434 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:41.755161 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:41.755558 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:41.770598 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Getting quotas for project c9eb7ba08d854864b6e2d1a7091737fb. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:44:41.775736 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Getting quotas for user 88cf026f8f364e87bdcc2b9eb8937d76 and project c9eb7ba08d854864b6e2d1a7091737fb. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:44:41.787054 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] [instance: a6082f69-c98c-41d4-94a8-5d155d8c942f] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:44:41.788030 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:41.788432 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:41.892182 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] [instance: a6082f69-c98c-41d4-94a8-5d155d8c942f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:44:41.893442 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:41.893874 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:42.220110 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:42.220523 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d2f10e30-581b-41d7-88cd-a687ce07f666 tempest-AttachVolumeTestJSON-548467221 tempest-AttachVolumeTestJSON-548467221-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:42.284598 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:44:42.304430 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:42.304844 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:42.589118 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:42.589784 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:42.591118 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:42.591772 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:42.611159 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Getting quotas for project 292df8a219a74bea9bab93a7b7b3e8b9. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:44:42.636833 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Getting quotas for user 51f0b74662bd4505913c834de9d8a47f and project 292df8a219a74bea9bab93a7b7b3e8b9. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:44:42.676981 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] [instance: f72f6ee7-c0b6-4a25-ad9b-1e1c4d02fe11] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:44:42.678044 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:42.678504 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:42.795683 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] [instance: f72f6ee7-c0b6-4a25-ad9b-1e1c4d02fe11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:44:42.796996 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:42.797485 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:42.835994 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:44:42.859751 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:42.860423 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.086069 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.086971 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.088135 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.088783 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.132393 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Getting quotas for project ac17845bcabc423381ee0555f855ee1b. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:44:43.134797 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Getting quotas for user b4e1b152dc854e40b952b55cc85e1def and project ac17845bcabc423381ee0555f855ee1b. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:44:43.160226 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] [instance: 18767ecb-209b-4919-b6c3-b81b1324831e] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:44:43.162101 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.162703 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.168649 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.169936 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5aadd383-14d3-4244-a75e-c7a0a68a47e5 tempest-VolumesBackupsTest-381819643 tempest-VolumesBackupsTest-381819643-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.327305 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] [instance: 18767ecb-209b-4919-b6c3-b81b1324831e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:44:43.332558 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.332558 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.440090 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:44:43.463909 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.464580 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.657050 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.658617 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.658884 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.659285 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.671958 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.672680 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-63726369-0088-491b-b3df-fd1f46c5a480 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.679356 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Getting quotas for project ac17845bcabc423381ee0555f855ee1b. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:44:43.692271 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Getting quotas for user b4e1b152dc854e40b952b55cc85e1def and project ac17845bcabc423381ee0555f855ee1b. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:44:43.696089 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] [instance: 2d3229d8-1506-42f3-9f4a-764edc3cb02b] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:44:43.697303 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.697889 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:43.801096 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] [instance: 2d3229d8-1506-42f3-9f4a-764edc3cb02b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:44:43.802506 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:43.803088 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:44.155312 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:44.155312 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1052dc5b-4b89-4f20-900d-f1bcf359fa9b tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:51.827725 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-764e40c9-bfa1-459a-82b5-ecd2b7e72e52 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method rebuild_instance {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:44:51.828624 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-764e40c9-bfa1-459a-82b5-ecd2b7e72e52 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:44:51.832898 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-764e40c9-bfa1-459a-82b5-ecd2b7e72e52 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:44:51.948624 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-764e40c9-bfa1-459a-82b5-ecd2b7e72e52 tempest-ServerShowV247Test-1041550648 tempest-ServerShowV247Test-1041550648-project] [instance: 2d3229d8-1506-42f3-9f4a-764edc3cb02b] No migration record for the rebuild/evacuate request. {{(pid=101512) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Aug 27 02:45:18.457296 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:45:18.487293 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:18.487293 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:18.645844 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:18.646607 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:18.647598 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:18.648155 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:18.672901 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:45:18.679483 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Getting quotas for user 91cf2d10bb46463db824705c4ea8f191 and project 037b4a4383a140e086b52e597b3b3109. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:45:18.695676 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: 1bb1ea28-c78e-4409-901c-f5d14c7b478e] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:45:18.697072 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:18.697695 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:18.846219 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] [instance: 1bb1ea28-c78e-4409-901c-f5d14c7b478e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:45:18.848121 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:18.848691 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:19.220367 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:19.220850 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-ffb5a9f5-16f9-4c97-b727-fe281e81906b tempest-DeleteServersTestJSON-1393756018 tempest-DeleteServersTestJSON-1393756018-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:25.863537 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:45:25.903464 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:25.903464 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:26.035023 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:26.035531 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:26.037392 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:26.037392 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:26.066497 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Getting quotas for project a7426cd217d447deb9f2ff71da1bccdd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:45:26.075367 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Getting quotas for user fd7360158dd1435c971b661cd1219e87 and project a7426cd217d447deb9f2ff71da1bccdd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:45:26.105035 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] [instance: 5389e405-3012-4ef3-8b03-6851ab09fc68] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:45:26.105035 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:26.105035 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:26.491346 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] [instance: 5389e405-3012-4ef3-8b03-6851ab09fc68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:45:26.492678 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:26.493174 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:26.824328 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:26.824849 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f9fbbf3-a72c-4ec7-8e87-704b1ff9ecce tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:40.679720 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:45:40.740485 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:40.741955 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:40.998936 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:41.001996 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:41.001996 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:41.001996 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:41.053867 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Getting quotas for project ecbcbde0c2d84039820b9eb1695be639. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:45:41.074577 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Getting quotas for user 47253022755d4ea79f05e06fcc5dadf4 and project ecbcbde0c2d84039820b9eb1695be639. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:45:41.103145 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] [instance: fd39c6fd-c6ca-469d-b62b-e3ed91a8c649] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:45:41.104112 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:41.104557 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:41.199737 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] [instance: fd39c6fd-c6ca-469d-b62b-e3ed91a8c649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:45:41.201004 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:41.201722 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:41.454701 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:41.455375 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1f80a65c-0338-42e9-a6a7-c903887c1a74 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:47.447436 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-c7365be9-7f3e-4e80-a67d-e076979a40f7 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method rebuild_instance {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:45:47.450242 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c7365be9-7f3e-4e80-a67d-e076979a40f7 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:45:47.454659 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c7365be9-7f3e-4e80-a67d-e076979a40f7 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:45:47.541782 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-c7365be9-7f3e-4e80-a67d-e076979a40f7 tempest-ServerShowV254Test-1533574547 tempest-ServerShowV254Test-1533574547-project] [instance: fd39c6fd-c6ca-469d-b62b-e3ed91a8c649] No migration record for the rebuild/evacuate request. {{(pid=101512) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Aug 27 02:46:01.311734 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:46:01.331582 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:01.335782 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:01.588681 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:01.589116 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:01.589956 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:01.592295 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:01.639244 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Getting quotas for project 5b46e36413af44adb52753b4a47dd994. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:46:01.651885 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Getting quotas for user b17586facb7f486289796538477881a0 and project 5b46e36413af44adb52753b4a47dd994. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:46:01.674972 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] [instance: 23e6ee62-c73e-45de-a8c7-ebb304c66dc5] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:46:01.679078 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:01.679674 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:01.764121 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] [instance: 23e6ee62-c73e-45de-a8c7-ebb304c66dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:46:01.766090 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:01.767445 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:01.861895 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:46:02.113274 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:02.118224 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3a997736-666e-421f-809d-e7c7cf547fb9 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:02.184326 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:46:02.894727 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58734. Aug 27 02:46:03.261573 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58744. Aug 27 02:46:31.013145 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:46:47.468054 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:46:47.502778 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:47.503242 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:47.658802 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:47.660093 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:47.661105 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:47.662498 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:47.683699 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Getting quotas for project 5b46e36413af44adb52753b4a47dd994. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:46:47.688487 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Getting quotas for user b17586facb7f486289796538477881a0 and project 5b46e36413af44adb52753b4a47dd994. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:46:47.703091 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] [instance: 87200222-1d3a-45a2-bd4d-85ae7c6dc9f9] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:46:47.704439 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:47.705065 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:47.803496 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] [instance: 87200222-1d3a-45a2-bd4d-85ae7c6dc9f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:46:47.809127 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:47.809127 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:46:48.104923 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:46:48.105770 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6f736d39-b7d7-473b-b527-a7a6b62ddad2 tempest-ServerRescueTestJSON-1883178792 tempest-ServerRescueTestJSON-1883178792-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:47:09.455274 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:47:09.479771 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:47:09.480524 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:47:09.658389 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:47:09.659847 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:47:09.660938 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:47:09.661756 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:47:09.685350 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Getting quotas for project d73d13e0fe5b4e2b91ad1b52d2bba0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:47:09.694369 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Getting quotas for user 50f1bbec8fea40cf9c0b80864e8e62ca and project d73d13e0fe5b4e2b91ad1b52d2bba0e0. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:47:09.712426 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: 515ad2d1-04e6-4bd9-8e36-261cb22b80e4] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:47:09.714746 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:47:09.715372 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:47:09.855254 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] [instance: 515ad2d1-04e6-4bd9-8e36-261cb22b80e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:47:09.859340 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:47:09.860894 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:47:10.496923 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:47:10.505804 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d4325c97-44ad-43c6-a675-f0f0fa6f81e6 tempest-MigrationsAdminTest-1039125821 tempest-MigrationsAdminTest-1039125821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:47:30.248473 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:47:30.251687 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:47:30.252497 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:47:30.955759 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] [instance: 515ad2d1-04e6-4bd9-8e36-261cb22b80e4] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101512) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 02:47:31.921333 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Created allocations for migration 3550bece-77d4-437b-b8c4-245f9dab03f9 on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:47:32.710876 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] [instance: 515ad2d1-04e6-4bd9-8e36-261cb22b80e4] Calling prep_resize with selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [] {{(pid=101512) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 02:47:33.121976 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.client.report [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Overwriting current allocation {'allocations': {'6e12de08-5d57-48b3-b442-9a192ba4e475': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}, 'generation': 98}}, 'project_id': 'd73d13e0fe5b4e2b91ad1b52d2bba0e0', 'user_id': '50f1bbec8fea40cf9c0b80864e8e62ca', 'consumer_generation': 1} on consumer 515ad2d1-04e6-4bd9-8e36-261cb22b80e4 {{(pid=101512) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 02:47:33.444852 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Created allocations for instance 515ad2d1-04e6-4bd9-8e36-261cb22b80e4 on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101512) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 02:47:33.492200 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:47:33.494952 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] [instance: 515ad2d1-04e6-4bd9-8e36-261cb22b80e4] Setting instance to ACTIVE state. Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server [None req-b5f9115b-490d-453b-a4b9-0afbf968e72f tempest-MigrationsAdminTest-101160295 tempest-MigrationsAdminTest-101160295-project-admin] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 02:47:34.250769 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 02:47:34.254823 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 02:47:34.255797 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:47:34.255797 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Aug 27 02:48:07.434871 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:48:07.478411 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:07.478867 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:07.737650 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:07.738413 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:07.739361 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:07.739973 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:07.765272 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Getting quotas for project f24bf2df78104819b3dba160127bf590. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:48:07.770958 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Getting quotas for user 2001e2d0f781414a96f3652b5eab2e22 and project f24bf2df78104819b3dba160127bf590. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:48:07.787902 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] [instance: 0661885c-2293-4d8c-8983-f5cc4b17ebaa] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:48:07.789932 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:07.790609 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:07.853682 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] [instance: 0661885c-2293-4d8c-8983-f5cc4b17ebaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:48:07.855429 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:07.856094 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:08.147862 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:08.148285 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-1aecc71f-6fcb-404b-bb56-886d234e74d0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:13.989724 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:48:14.017841 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:14.018559 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:14.169040 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:14.173063 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:14.173063 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:14.176970 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:14.208763 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Getting quotas for project a7426cd217d447deb9f2ff71da1bccdd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:48:14.215073 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Getting quotas for user fd7360158dd1435c971b661cd1219e87 and project a7426cd217d447deb9f2ff71da1bccdd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:48:14.229497 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] [instance: ceb22a8f-63f2-44e0-9508-6e38693cf17c] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:48:14.230659 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:14.231221 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:14.340526 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] [instance: ceb22a8f-63f2-44e0-9508-6e38693cf17c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:48:14.341685 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:14.342091 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:14.669726 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:14.670489 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e8cd6bf6-d1f9-407f-bf0e-a20f35308901 tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:33.227694 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:48:33.257722 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:33.258365 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:33.448017 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:33.448428 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:33.449163 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:33.449596 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:33.484765 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Getting quotas for project 6e5569360b0a4cd3916a1728f2ebab2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:48:33.491039 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Getting quotas for user 1ee9ea5184c2431c89588f7f1bf40466 and project 6e5569360b0a4cd3916a1728f2ebab2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:48:33.512535 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] [instance: 2a2d3a5f-17fb-4986-a71c-b28f023cd4f5] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:48:33.513520 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:33.518936 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:33.591199 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] [instance: 2a2d3a5f-17fb-4986-a71c-b28f023cd4f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:48:33.592750 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:33.593319 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:33.940539 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:33.940955 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77d2a85b-7a0b-4205-90ad-eb17797329a4 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:41.309620 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:48:41.341920 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:41.342367 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:41.497389 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:41.498075 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:41.499252 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:41.499940 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:41.517880 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Getting quotas for project a7426cd217d447deb9f2ff71da1bccdd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:48:41.523996 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Getting quotas for user fd7360158dd1435c971b661cd1219e87 and project a7426cd217d447deb9f2ff71da1bccdd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:48:41.537194 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] [instance: 80a46f96-1470-482d-9db7-becd08dc1b19] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:48:41.540708 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:41.540708 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:41.621054 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] [instance: 80a46f96-1470-482d-9db7-becd08dc1b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:48:41.622495 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:41.623088 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:48:41.865946 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:48:41.866366 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-544ccf47-17d5-40ba-81fc-dc8149f83bdd tempest-ServerActionsTestJSON-414325189 tempest-ServerActionsTestJSON-414325189-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:02.888717 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 02:49:03.217062 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 02:49:03.830068 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:49:03.830566 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:03.830978 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:03.920112 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35686. Aug 27 02:49:04.250489 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35712. Aug 27 02:49:04.359015 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] [instance: 0661885c-2293-4d8c-8983-f5cc4b17ebaa] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101511) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 02:49:05.220391 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Created allocations for migration 0d8fb55d-5e72-40d2-944d-988d88f82e10 on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101511) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:49:05.701097 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] [instance: 0661885c-2293-4d8c-8983-f5cc4b17ebaa] Calling prep_resize with selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [] {{(pid=101511) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 02:49:06.263492 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.client.report [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Overwriting current allocation {'allocations': {'6e12de08-5d57-48b3-b442-9a192ba4e475': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}, 'generation': 102}}, 'project_id': 'f24bf2df78104819b3dba160127bf590', 'user_id': '2001e2d0f781414a96f3652b5eab2e22', 'consumer_generation': 1} on consumer 0661885c-2293-4d8c-8983-f5cc4b17ebaa {{(pid=101511) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 02:49:06.519450 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Created allocations for instance 0661885c-2293-4d8c-8983-f5cc4b17ebaa on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101511) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 02:49:06.679950 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.utils [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:49:06.681115 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.utils [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] [instance: 0661885c-2293-4d8c-8983-f5cc4b17ebaa] Setting instance to ACTIVE state. Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server [None req-60ed2daa-efb9-49aa-87e0-05b64748a84f tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 02:49:07.167011 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 02:49:07.168189 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 02:49:07.169498 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:49:07.169498 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Aug 27 02:49:11.624729 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:49:11.694602 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:11.695126 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:11.918726 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:11.927571 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:11.928763 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:11.930464 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:11.975580 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Getting quotas for project 6e5569360b0a4cd3916a1728f2ebab2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:49:11.990876 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Getting quotas for user 1ee9ea5184c2431c89588f7f1bf40466 and project 6e5569360b0a4cd3916a1728f2ebab2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:49:12.013973 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] [instance: d8bf719c-c1cc-4756-a098-b3f8c1af2cfd] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:49:12.019445 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:12.019872 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:12.122178 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] [instance: d8bf719c-c1cc-4756-a098-b3f8c1af2cfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:49:12.124590 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:12.125233 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:12.368993 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:12.369821 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-5f39ddb6-cce7-453e-9ebd-ea9d74c45c43 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:39.387422 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:49:39.412876 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:39.413512 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:39.585932 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:39.586596 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:39.587320 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:39.587775 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:39.617609 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Getting quotas for project 6e5569360b0a4cd3916a1728f2ebab2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:49:39.640950 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Getting quotas for user 1ee9ea5184c2431c89588f7f1bf40466 and project 6e5569360b0a4cd3916a1728f2ebab2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:49:39.675351 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] [instance: 783640e9-40be-4b9a-ae58-e2427f0fc193] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:49:39.680589 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:39.680589 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:39.776908 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] [instance: 783640e9-40be-4b9a-ae58-e2427f0fc193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:49:39.779178 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:39.780980 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:49:40.041549 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:49:40.042261 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-4c857f4b-4721-4ee1-a05a-f17c10a507c1 tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:28.954523 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:50:28.993876 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:28.994372 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:29.173302 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:29.176483 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:29.177429 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:29.178007 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:29.200739 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Getting quotas for project 6e5569360b0a4cd3916a1728f2ebab2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:50:29.206932 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Getting quotas for user 1ee9ea5184c2431c89588f7f1bf40466 and project 6e5569360b0a4cd3916a1728f2ebab2d. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:50:29.235210 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] [instance: 425706df-fede-44be-bfe9-cfd3a5cec84a] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:50:29.240117 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:29.242586 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:29.358675 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] [instance: 425706df-fede-44be-bfe9-cfd3a5cec84a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:50:29.360164 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:29.360668 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:29.646050 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:29.646467 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a7313bfd-cd51-4025-8ee4-ea7baa72d2fe tempest-AttachVolumeNegativeTest-1602890897 tempest-AttachVolumeNegativeTest-1602890897-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:44.944105 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:50:44.970035 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:44.970727 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:45.218939 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:45.220046 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:45.220752 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:45.221141 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:45.243457 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Getting quotas for project 2906df0fedbe40a2b65208cdb6bd8210. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:50:45.245121 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Getting quotas for user d054391f5a914302b1fa87b9060217a8 and project 2906df0fedbe40a2b65208cdb6bd8210. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:50:45.267165 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] [instance: a1d76224-ff7f-435d-a070-f3814fdd1826] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:50:45.268355 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:45.268763 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:45.363545 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] [instance: a1d76224-ff7f-435d-a070-f3814fdd1826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:50:45.365663 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:45.365663 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:50:45.662585 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:50:45.663345 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b6d7d5e-5b47-4f4f-a4ce-a117b0985965 tempest-ServerAddressesTestJSON-1963629413 tempest-ServerAddressesTestJSON-1963629413-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:16.087007 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:51:16.145664 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:16.148690 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:16.437416 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:16.437991 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:16.439858 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:16.440278 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:16.500320 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Getting quotas for project fe03840595c742abb8afa186c09f3bb9. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:51:16.524313 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Getting quotas for user ddf8a50a37414cde9c7b62ddb0c80ffc and project fe03840595c742abb8afa186c09f3bb9. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:51:16.581327 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] [instance: b2db2660-db84-4c43-9302-8ae1fdec4f9e] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:51:16.582356 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:16.582761 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:16.696383 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] [instance: b2db2660-db84-4c43-9302-8ae1fdec4f9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:51:16.700639 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:16.701297 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:17.367456 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:17.369740 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1740bf16-244b-45ba-9615-32abc7a141ab tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:31.037747 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:51:38.106011 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:51:38.128772 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:38.129468 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:38.391618 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:38.392036 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:38.392784 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:38.396239 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:38.452289 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Getting quotas for project fe03840595c742abb8afa186c09f3bb9. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:51:38.458971 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Getting quotas for user ddf8a50a37414cde9c7b62ddb0c80ffc and project fe03840595c742abb8afa186c09f3bb9. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:51:38.476324 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] [instance: 884d1a16-189c-4229-bc28-4498d7db0feb] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:51:38.477334 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:38.486708 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:38.551055 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] [instance: 884d1a16-189c-4229-bc28-4498d7db0feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:51:38.552264 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:38.552790 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:51:38.899960 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:51:38.900351 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-47e16313-526c-42f5-b91b-f22e4947cef5 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:52:03.921302 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 02:52:04.249367 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 02:52:04.979832 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41426. Aug 27 02:52:05.279882 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41438. Aug 27 02:53:22.375924 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:53:22.405109 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:53:22.407489 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:53:22.883712 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:53:22.885028 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:53:22.886041 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:53:22.886696 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:53:22.904710 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Getting quotas for project b224506f0c0d4c7bbed7961f4969f10f. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:53:22.910034 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Getting quotas for user 511c8dfd92be4889894293bfeabb0310 and project b224506f0c0d4c7bbed7961f4969f10f. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:53:22.921361 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] [instance: 415953b4-b460-4e06-9703-6dc957396be7] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:53:22.922646 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:53:22.923259 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:53:23.132742 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] [instance: 415953b4-b460-4e06-9703-6dc957396be7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:53:23.135366 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:53:23.136033 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:53:23.521398 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:53:23.522132 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-75cae930-8a0b-4f80-810f-98b25cb49bc3 tempest-VolumesNegativeTest-134668165 tempest-VolumesNegativeTest-134668165-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:53:24.376460 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:53:24.823403 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-66f18df2-c915-4cb8-8335-4ab01bf91827 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method unshelve_instance {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:53:24.824027 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-66f18df2-c915-4cb8-8335-4ab01bf91827 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:53:24.824499 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-66f18df2-c915-4cb8-8335-4ab01bf91827 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:53:26.032862 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-66f18df2-c915-4cb8-8335-4ab01bf91827 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] [instance: b2db2660-db84-4c43-9302-8ae1fdec4f9e] Requesting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) during scheduling {{(pid=101511) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:930}} Aug 27 02:53:26.453606 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-66f18df2-c915-4cb8-8335-4ab01bf91827 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:53:26.464194 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-66f18df2-c915-4cb8-8335-4ab01bf91827 tempest-ServersNegativeTestJSON-2049010393 tempest-ServersNegativeTestJSON-2049010393-project] Lazy-loading 'flavor' on Instance uuid b2db2660-db84-4c43-9302-8ae1fdec4f9e {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 02:54:10.262714 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:54:10.304141 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:10.304708 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:10.638416 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:10.639193 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:10.641926 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:10.645920 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:10.697126 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:54:10.711313 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for user 3dd798f7ee6a4305a74452b71c1bfbf1 and project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:54:10.742131 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: b4d9fe94-37c6-4bbc-8f53-fe3758ab81ae] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:54:10.743717 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:10.744657 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:10.811311 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: b4d9fe94-37c6-4bbc-8f53-fe3758ab81ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:54:10.812483 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:10.813108 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:11.166224 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:11.166906 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ec77289b-5955-4fd4-b1dd-2b11cfd00fab tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:19.628533 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:54:19.676223 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:19.677169 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:19.997322 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:19.997934 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:19.999064 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:19.999615 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:20.046788 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Getting quotas for project 36b640f7171b44e0a2030502d997da79. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:54:20.065589 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Getting quotas for user 626969f90b81469eacc8393ad3677d28 and project 36b640f7171b44e0a2030502d997da79. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:54:20.081727 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] [instance: cd959ea8-74d1-477f-abf3-9dca58e8c948] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:54:20.085527 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.utils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-802225-4']) and/or node ([]) {{(pid=101511) populate_retry /opt/stack/nova/nova/scheduler/utils.py:953}} Aug 27 02:54:20.085527 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:20.085527 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:20.149616 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] [instance: cd959ea8-74d1-477f-abf3-9dca58e8c948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:54:20.151787 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:20.152386 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:20.387402 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:20.389043 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f00ffbd7-1c6c-483d-bc1e-36dbbea8b7ba tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:39.910937 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:39.911555 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:40.967433 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Took 1.02 seconds to select destinations for 2 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:54:41.020857 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:41.026195 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:41.288588 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:41.289320 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:41.632705 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:41.633436 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:41.634522 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:41.635093 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:41.677309 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:54:41.677309 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for user 3dd798f7ee6a4305a74452b71c1bfbf1 and project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:54:41.679199 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 299fa5aa-49db-40c9-85fd-a8c644c31c0a] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:54:41.680164 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:41.680581 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:41.809489 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 299fa5aa-49db-40c9-85fd-a8c644c31c0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:54:41.811145 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:41.811831 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:42.180422 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:42.181074 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:42.197432 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 44c5f904-9fa9-4b11-bf8c-0157f95ba936] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:54:42.198063 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance_group [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lazy-loading 'hosts' on InstanceGroup uuid 4cd37f21-207b-480e-a264-bce8d0e2bfec {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:356}} Aug 27 02:54:42.209897 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:42.210331 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:42.336742 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 44c5f904-9fa9-4b11-bf8c-0157f95ba936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:54:42.338753 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:42.339452 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:42.939850 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:42.941187 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-55ee5d13-17af-4e12-86dd-7d3ca179b86a tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:47.760048 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:54:47.877492 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:47.882809 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:48.199373 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:48.199692 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:48.200619 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:48.201176 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:48.267646 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Getting quotas for project 36b640f7171b44e0a2030502d997da79. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:54:48.280780 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Getting quotas for user 626969f90b81469eacc8393ad3677d28 and project 36b640f7171b44e0a2030502d997da79. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:54:48.323430 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] [instance: 84a9cf8a-5d30-4303-b693-04720742db97] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:54:48.326092 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.utils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-802225-4']) and/or node ([]) {{(pid=101511) populate_retry /opt/stack/nova/nova/scheduler/utils.py:953}} Aug 27 02:54:48.329406 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:48.333990 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:48.483769 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] [instance: 84a9cf8a-5d30-4303-b693-04720742db97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:54:48.485263 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:48.485814 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:48.907362 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:54:48.908048 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8389e17f-3b47-4ada-964b-113bdd12c6c8 tempest-TestServerMultinode-1468934996 tempest-TestServerMultinode-1468934996-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:54:51.060907 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:55:04.980932 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:55:05.279174 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 02:55:06.002609 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47198. Aug 27 02:55:06.318033 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47206. Aug 27 02:55:15.550487 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:15.551180 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:16.918357 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Took 1.28 seconds to select destinations for 2 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:55:16.998991 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:16.998991 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:17.230336 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:17.232642 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:17.471010 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:17.474815 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:17.475950 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:17.476358 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:17.536100 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:55:17.550696 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for user 3dd798f7ee6a4305a74452b71c1bfbf1 and project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:55:17.580235 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 64d6f21f-ce84-4411-8e1d-185a06bc4a56] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:55:17.583882 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:17.584299 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:17.752978 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 64d6f21f-ce84-4411-8e1d-185a06bc4a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:55:17.754937 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:17.755532 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:18.078211 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:18.079507 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:18.093367 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 750c8c86-6a83-46e2-aa45-91fa0d44e820] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:55:18.101240 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance_group [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lazy-loading 'hosts' on InstanceGroup uuid 98463d62-593e-4744-8280-85359643b0ba {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:356}} Aug 27 02:55:18.119872 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:18.120810 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:18.244240 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 750c8c86-6a83-46e2-aa45-91fa0d44e820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:55:18.247895 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:18.250210 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:18.614638 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:18.615058 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-214f1676-87b5-4302-b875-cbf9f9bba270 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:50.050860 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:55:50.073427 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:50.074095 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:50.242537 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:50.243033 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:50.249418 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:50.249891 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:50.305603 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:55:50.342750 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for user 3dd798f7ee6a4305a74452b71c1bfbf1 and project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:55:50.384478 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: b2f9f4b7-2854-4232-b31b-da425b4bce9c] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:55:50.385721 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:50.397843 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:50.543892 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: b2f9f4b7-2854-4232-b31b-da425b4bce9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:55:50.552419 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:50.552419 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:50.959503 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:50.960301 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bd0c26f4-ee13-4cd2-8b52-346e233b0f50 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:55:59.841019 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:55:59.883797 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:55:59.884215 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:00.081581 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:00.082386 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:00.083348 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:00.090063 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:00.169310 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Getting quotas for project f24bf2df78104819b3dba160127bf590. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:56:00.175734 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Getting quotas for user 2001e2d0f781414a96f3652b5eab2e22 and project f24bf2df78104819b3dba160127bf590. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:56:00.190691 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] [instance: b0e700ac-0625-4925-8518-e456d21c2ce0] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:56:00.192027 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:00.192646 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:00.367993 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] [instance: b0e700ac-0625-4925-8518-e456d21c2ce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:56:00.370034 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:00.374382 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:00.673056 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:00.673874 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-360a533f-9f81-4b2d-8064-1a6b6c6f08d5 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:12.698659 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:56:12.741283 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:12.741732 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:12.977676 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:12.979932 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:12.980601 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:12.980954 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:13.012168 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:56:13.023939 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for user 3dd798f7ee6a4305a74452b71c1bfbf1 and project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:56:13.069192 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 1196a472-3db8-4d16-8908-99fc695214a5] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:56:13.069192 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:13.069192 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:13.190153 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 1196a472-3db8-4d16-8908-99fc695214a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:56:13.191481 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:13.192104 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:13.581117 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:13.582270 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2d8851ff-eba2-4443-bda7-e78bbd78e2f6 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:35.822312 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:56:35.846121 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:35.854706 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:36.123855 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:36.124530 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:36.125992 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:36.126544 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:36.148120 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:56:36.156835 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Getting quotas for user 3dd798f7ee6a4305a74452b71c1bfbf1 and project 277770df617144e3959ab880fc4809ef. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:56:36.178283 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 38cc06a6-950e-44cb-8f12-92de6f5a5ad3] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:56:36.178283 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:36.178283 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:36.296064 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] [instance: 38cc06a6-950e-44cb-8f12-92de6f5a5ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:56:36.298602 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:36.299177 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:36.682144 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:56:36.682707 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-346b033e-06d8-4e63-a701-89ab7e7d2973 tempest-ServersOnMultiNodesTest-1550957701 tempest-ServersOnMultiNodesTest-1550957701-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:56:44.396632 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:57:45.032466 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:57:45.084216 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:57:45.084628 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:57:45.351712 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:57:45.352405 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:57:45.353290 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:57:45.354352 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:57:45.395930 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Getting quotas for project 5a459e67fd8a474889519b6a33d48d2c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:57:45.401193 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Getting quotas for user 80be519de71b40c59b2c90a2bb6cf5ae and project 5a459e67fd8a474889519b6a33d48d2c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:57:45.423206 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] [instance: f857f884-2b5e-442b-928c-3f56bd9236a3] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:57:45.424523 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:57:45.425231 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:57:45.554089 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] [instance: f857f884-2b5e-442b-928c-3f56bd9236a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:57:45.557375 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:57:45.558255 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:57:45.901802 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:57:45.901802 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5c4615ae-44f7-4f82-93ef-888b16d1d82e tempest-TenantUsagesTestJSON-741416936 tempest-TenantUsagesTestJSON-741416936-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:57:57.031502 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 02:57:57.037800 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:57:57.041299 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:57:57.907671 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] [instance: b0e700ac-0625-4925-8518-e456d21c2ce0] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101512) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 02:57:58.990095 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Created allocations for migration 7204de2b-919a-4d80-8d91-e9d4b2fb6756 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 02:57:59.552042 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] [instance: b0e700ac-0625-4925-8518-e456d21c2ce0] Calling prep_resize with selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101512) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 02:57:59.959459 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.client.report [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Overwriting current allocation {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}, 'generation': 168}}, 'project_id': 'f24bf2df78104819b3dba160127bf590', 'user_id': '2001e2d0f781414a96f3652b5eab2e22', 'consumer_generation': 1} on consumer b0e700ac-0625-4925-8518-e456d21c2ce0 {{(pid=101512) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 02:58:00.400833 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Created allocations for instance b0e700ac-0625-4925-8518-e456d21c2ce0 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 02:58:00.449706 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:58:00.454095 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] [instance: b0e700ac-0625-4925-8518-e456d21c2ce0] Setting instance to ACTIVE state. Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server [None req-036ae15e-4b98-4f3d-98fe-31d590da1154 tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 02:58:01.066472 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 02:58:01.074000 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 02:58:01.075701 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 02:58:01.075701 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Aug 27 02:58:06.001077 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 02:58:06.310507 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 02:58:07.045227 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51078. Aug 27 02:58:07.359453 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51090. Aug 27 02:58:11.093891 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:58:24.637154 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:58:24.666693 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:58:24.667560 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:58:24.920359 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:58:24.921016 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:58:24.922124 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:58:24.923219 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:58:24.961275 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Getting quotas for project 204cb002765a4b06ba232b73799b9cc4. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:58:24.976386 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Getting quotas for user f6be1dc300a046c39efc243a60a9b244 and project 204cb002765a4b06ba232b73799b9cc4. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:58:25.007439 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] [instance: 73a040d3-b282-45f0-9a99-7ac607280d9c] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:58:25.008647 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:58:25.009204 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:58:25.079360 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] [instance: 73a040d3-b282-45f0-9a99-7ac607280d9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:58:25.080627 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:58:25.081080 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:58:25.382144 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:58:25.382813 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3c2603bb-a684-46c0-a630-653d170356f2 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:13.723493 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:59:13.769158 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:13.769597 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:14.155340 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:14.156565 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:14.158124 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:14.158797 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:14.183714 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Getting quotas for project 38864af3c85049e78df4803655b381a7. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:59:14.190887 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Getting quotas for user 31f2400f12954998a885faace84d7ef6 and project 38864af3c85049e78df4803655b381a7. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:59:14.209564 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] [instance: df7816e7-b3ef-419a-bf00-2d0d24892675] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:59:14.211119 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:14.213348 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:14.277206 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] [instance: df7816e7-b3ef-419a-bf00-2d0d24892675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2f52e81a-9842-4c2d-af1c-1d704ab676c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:59:14.279061 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:14.280133 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:14.638536 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:14.639128 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-507d8e0f-2dc0-42e0-a766-5b2ca33c7d80 tempest-AttachSCSIVolumeTestJSON-1315822819 tempest-AttachSCSIVolumeTestJSON-1315822819-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:44.850068 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:59:44.884961 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:44.884961 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:45.148448 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:45.148448 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:45.148448 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:45.148448 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:45.167566 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Getting quotas for project c5bd89807b2844ce91889cb61da0dbbd. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:59:45.173857 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Getting quotas for user 11e4808ca9624b21a56d98396b92aea6 and project c5bd89807b2844ce91889cb61da0dbbd. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:59:45.197211 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] [instance: 0e28d2c6-19a7-4e9f-8cab-c62d251dd1da] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:59:45.197211 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:45.197211 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:45.252904 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] [instance: 0e28d2c6-19a7-4e9f-8cab-c62d251dd1da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 02:59:45.254520 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:45.254928 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:45.438740 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:45.439494 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-87ab30e7-ba5c-4b69-a592-f7d207a70e6b tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:59.373713 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 02:59:59.395090 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:59.395844 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:59.723005 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:59.723497 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:59.724322 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:59.724716 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 02:59:59.740855 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Getting quotas for project a7a7998bc5c94a5685fc0c2b8aa2c867. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 02:59:59.754843 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Getting quotas for user 164b96acb5764dbdb3db8113bf7f04d8 and project a7a7998bc5c94a5685fc0c2b8aa2c867. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 02:59:59.767173 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] [instance: df756490-a8e4-40a1-83f1-fee1466c5b57] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 02:59:59.768122 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 02:59:59.768523 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:00.007266 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] [instance: df756490-a8e4-40a1-83f1-fee1466c5b57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:00:00.008584 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:00.009574 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:00.467270 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:00.467270 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-08cc9ba0-56b6-400d-b826-72a9905159b3 tempest-VolumesActionsTest-1239565022 tempest-VolumesActionsTest-1239565022-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:28.366229 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:00:28.425923 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:28.426661 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:28.717991 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:28.718632 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:28.719567 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:28.719989 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:28.736949 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Getting quotas for project 204cb002765a4b06ba232b73799b9cc4. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:00:28.742907 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Getting quotas for user f6be1dc300a046c39efc243a60a9b244 and project 204cb002765a4b06ba232b73799b9cc4. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:00:28.759087 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] [instance: 7aa46fcc-a377-4cef-a497-7c69659e62dc] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:00:28.759087 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:28.759087 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:28.903294 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] [instance: 7aa46fcc-a377-4cef-a497-7c69659e62dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:00:28.904866 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:28.905140 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:29.128029 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:29.128943 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9b2fd621-79c5-44c5-95f9-31dbbd9bd985 tempest-VolumesSnapshotTestJSON-1050120716 tempest-VolumesSnapshotTestJSON-1050120716-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:47.434724 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:00:47.469047 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:47.469484 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:47.624106 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:47.624786 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:47.625679 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:47.627249 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:47.689413 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Getting quotas for project c5bd89807b2844ce91889cb61da0dbbd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:00:47.710137 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Getting quotas for user 11e4808ca9624b21a56d98396b92aea6 and project c5bd89807b2844ce91889cb61da0dbbd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:00:47.736125 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] [instance: 758f2119-a029-4841-b5bb-c3545995700a] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:00:47.740645 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:47.741305 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:47.816613 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] [instance: 758f2119-a029-4841-b5bb-c3545995700a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:00:47.818737 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:47.819242 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:48.091949 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:48.092534 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-9e2d7398-43f3-4cfd-865d-ced28210af02 tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:49.309968 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:00:49.384342 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:49.384764 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:49.663789 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:49.664441 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:49.665348 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:49.666510 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:49.714159 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Getting quotas for project 04b22a8001f44382812c49be76958e33. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:00:49.719705 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Getting quotas for user 9c460946a66949adbd9f808d1018e4ed and project 04b22a8001f44382812c49be76958e33. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:00:49.734618 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] [instance: 337d6b74-e927-4079-9385-a41acd67767c] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:00:49.738134 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:49.738134 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:49.795191 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] [instance: 337d6b74-e927-4079-9385-a41acd67767c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:00:49.797053 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:49.797684 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:00:50.168889 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:00:50.170689 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d2d735a7-707e-4030-94a8-b118f84f6ab2 tempest-FloatingIPsAssociationNegativeTestJSON-942949519 tempest-FloatingIPsAssociationNegativeTestJSON-942949519-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:01:07.048245 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:01:07.337146 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:01:08.075219 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55284. Aug 27 03:01:08.380756 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55294. Aug 27 03:01:31.125154 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:02:11.781631 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:02:11.810435 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:11.810839 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:12.009086 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:12.013759 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:12.015058 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:12.015785 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:12.065925 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Getting quotas for project c5bd89807b2844ce91889cb61da0dbbd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:02:12.079380 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Getting quotas for user 11e4808ca9624b21a56d98396b92aea6 and project c5bd89807b2844ce91889cb61da0dbbd. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:02:12.113172 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] [instance: 02ba4131-0d29-4047-8899-f760c32faa8a] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:02:12.114332 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:12.114905 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:12.253234 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] [instance: 02ba4131-0d29-4047-8899-f760c32faa8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:02:12.254843 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:12.255249 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:12.740819 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:12.741245 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e391b53c-e7b4-4239-be12-47078503ea8d tempest-TestNetworkBasicOps-166660963 tempest-TestNetworkBasicOps-166660963-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:24.733227 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:02:24.756282 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:24.760191 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:25.026005 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:25.026759 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:25.027745 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:25.028435 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:25.052728 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Getting quotas for project b3675467f80d4e048bb97a5152b8664c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:02:25.060431 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Getting quotas for user 5a38160b2cd14104a28866bdecece444 and project b3675467f80d4e048bb97a5152b8664c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:02:25.072259 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] [instance: 107dc614-1b70-4cfa-9581-02716e1b48e7] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:02:25.073367 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:25.073848 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:25.211798 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] [instance: 107dc614-1b70-4cfa-9581-02716e1b48e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:02:25.211798 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:25.211798 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:25.530896 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:25.532449 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-027e8f1b-c101-42e9-8159-0db53590140e tempest-TestServerBasicOps-1917604074 tempest-TestServerBasicOps-1917604074-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:40.300353 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:02:40.324295 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:40.324562 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:40.606223 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:40.606223 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:40.612782 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:40.613643 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:40.653111 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Getting quotas for project f5f31e4f4c6448148a7f493da0cbc7c6. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:02:40.665101 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Getting quotas for user a1573dfc7908408292d3f77817ec2b32 and project f5f31e4f4c6448148a7f493da0cbc7c6. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:02:40.723968 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] [instance: a06c5fd2-8d92-44be-8b71-b48bab7be81b] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:02:40.725323 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:40.726267 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:40.796675 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] [instance: a06c5fd2-8d92-44be-8b71-b48bab7be81b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:02:40.799350 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:40.799944 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:02:41.052477 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:02:41.053280 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d517f11d-cc14-4780-ad6b-a917b78156d6 tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:24.333438 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:03:24.357839 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:24.358240 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:24.424316 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:03:24.498871 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:24.499280 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:24.500010 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:24.500399 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:24.519544 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Getting quotas for project f5f31e4f4c6448148a7f493da0cbc7c6. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:03:24.524372 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Getting quotas for user a1573dfc7908408292d3f77817ec2b32 and project f5f31e4f4c6448148a7f493da0cbc7c6. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:03:24.536764 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] [instance: 7410c2e0-da7f-4b9c-b92b-f755cd621929] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:03:24.537774 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:24.543177 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:24.762748 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] [instance: 7410c2e0-da7f-4b9c-b92b-f755cd621929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:03:24.764026 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:24.764435 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:25.082455 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:25.083002 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-9695a3d1-1424-495f-abf0-735fece2011d tempest-ServersTestMultiNic-914429865 tempest-ServersTestMultiNic-914429865-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:40.281883 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:03:40.317727 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:40.318779 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:40.569797 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:40.571067 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:40.578579 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:40.578579 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:40.598460 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Getting quotas for project 20f25894c3cc4ac88e6dfc8f24ff526a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:03:40.609097 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Getting quotas for user 27d616b5422f453095fa009edaa88510 and project 20f25894c3cc4ac88e6dfc8f24ff526a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:03:40.622618 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] [instance: 7a598b0a-4c31-4e42-9418-8f6afa429352] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:03:40.623843 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:40.624444 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:40.722095 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] [instance: 7a598b0a-4c31-4e42-9418-8f6afa429352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:03:40.723401 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:40.723831 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:03:41.126098 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:03:41.126710 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-eb0a6ff6-4393-496b-9f77-fa4c2a8627cc tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:04:08.079072 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:04:08.377814 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:04:09.102625 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58120. Aug 27 03:04:09.400480 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58122. Aug 27 03:04:23.074049 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:04:23.100591 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:04:23.100994 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:04:23.241281 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:04:23.241811 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:04:23.242541 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:04:23.242966 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:04:23.289643 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Getting quotas for project f24bf2df78104819b3dba160127bf590. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:04:23.289643 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Getting quotas for user 2001e2d0f781414a96f3652b5eab2e22 and project f24bf2df78104819b3dba160127bf590. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:04:23.303480 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] [instance: a4978304-9385-49c6-96a0-3f8b101169fd] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:04:23.304747 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:04:23.305363 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:04:23.388687 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] [instance: a4978304-9385-49c6-96a0-3f8b101169fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:04:23.390270 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:04:23.391276 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:04:23.755016 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:04:23.762693 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-220a6414-0fd7-4ed2-ab2a-06fe133c63c0 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:04:51.154212 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:05:00.056731 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:05:00.076514 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:00.076927 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:00.300688 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:00.301085 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:00.301838 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:00.302233 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:00.316410 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Getting quotas for project f011bd2108124a5faa01e0850d8113f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:05:00.320768 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Getting quotas for user cb1e2baa163048d29bc04abd89f8d018 and project f011bd2108124a5faa01e0850d8113f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:05:00.331579 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] [instance: 702c2b10-c272-4292-bba3-713924509504] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:05:00.332471 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:00.332870 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:00.377158 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] [instance: 702c2b10-c272-4292-bba3-713924509504] block_device_mapping [BlockDeviceMapping(attachment_id=3f1e8897-57a7-4cbd-b2dd-96dae7d95dc7,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f7b05420-ca12-42ad-abdc-d335f4740580',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=97414767-a18d-4ef5-97f2-0c25bcab8147,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a07a3f12-a117-4815-9ca2-6c152fcf1552',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=12c60a76-a75f-478a-bccc-a5ebf9afccde,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63d41abd-57c1-459a-a5e9-7c56bb5601b4',volume_size=1,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:05:00.380148 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:00.380782 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:00.451175 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:00.451578 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:00.504706 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:00.505208 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:00.680576 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:00.681010 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-3c094b71-a3b7-47d3-b78a-69aecb6c911a tempest-TaggedBootDevicesTest-850719286 tempest-TaggedBootDevicesTest-850719286-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:11.251335 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-fd155c05-795c-4c4c-9993-a51051d2f28b tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 03:05:11.251929 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-fd155c05-795c-4c4c-9993-a51051d2f28b tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:11.253304 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-fd155c05-795c-4c4c-9993-a51051d2f28b tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:12.225583 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-fd155c05-795c-4c4c-9993-a51051d2f28b tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Created allocations for migration 1a494524-5096-4503-894c-0de901c20c9a on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101511) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 03:05:12.691951 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.live_migrate [None req-fd155c05-795c-4c4c-9993-a51051d2f28b tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] [instance: a4978304-9385-49c6-96a0-3f8b101169fd] Requesting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while live migrating {{(pid=101511) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:494}} Aug 27 03:05:13.149224 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-fd155c05-795c-4c4c-9993-a51051d2f28b tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Lazy-loading 'resources' on Instance uuid a4978304-9385-49c6-96a0-3f8b101169fd {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:05:13.159818 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-fd155c05-795c-4c4c-9993-a51051d2f28b tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] Lazy-loading 'pci_requests' on Instance uuid a4978304-9385-49c6-96a0-3f8b101169fd {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 03:05:14.041136 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.live_migrate [None req-fd155c05-795c-4c4c-9993-a51051d2f28b tempest-TestNetworkAdvancedServerOps-1646178163 tempest-TestNetworkAdvancedServerOps-1646178163-project-admin] [instance: a4978304-9385-49c6-96a0-3f8b101169fd] Start binding ports on destination host: n-h1-802225-4 {{(pid=101511) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Aug 27 03:05:17.057193 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:05:17.094044 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:17.094458 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:17.308187 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:17.309053 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:17.310090 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:17.316414 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:17.358007 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Getting quotas for project 20f25894c3cc4ac88e6dfc8f24ff526a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:05:17.377719 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Getting quotas for user 27d616b5422f453095fa009edaa88510 and project 20f25894c3cc4ac88e6dfc8f24ff526a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:05:17.395823 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] [instance: 634a7277-cf95-4156-8464-5206eb321d58] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:05:17.402816 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:17.403486 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:17.486474 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] [instance: 634a7277-cf95-4156-8464-5206eb321d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:05:17.488155 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:17.488731 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:17.784204 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:17.784902 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-1705f862-3be1-4f88-95d2-4432fd4098e1 tempest-TestSecurityGroupsBasicOps-592298732 tempest-TestSecurityGroupsBasicOps-592298732-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:59.161972 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:05:59.193096 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:59.194063 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:59.391807 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:59.392436 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:59.393686 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:59.394341 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:59.457296 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Getting quotas for project f24bf2df78104819b3dba160127bf590. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:05:59.462733 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Getting quotas for user 2001e2d0f781414a96f3652b5eab2e22 and project f24bf2df78104819b3dba160127bf590. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:05:59.474553 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] [instance: b0e6ef29-cdde-454f-a3a9-3d996e6baa35] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:05:59.475865 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:59.476496 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:59.531811 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] [instance: b0e6ef29-cdde-454f-a3a9-3d996e6baa35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:05:59.533803 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:59.534684 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:05:59.909942 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:05:59.910637 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-cda331ad-e308-4510-927b-72e116b79cbd tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:06:30.171168 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:06:30.193549 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:06:30.193981 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:06:30.335615 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:06:30.335943 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:06:30.336676 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:06:30.337072 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:06:30.352662 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Getting quotas for project 387e926594054a76ba5982b35901a389. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:06:30.357584 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Getting quotas for user d3662595183840fbbadcccaf6e7a761c and project 387e926594054a76ba5982b35901a389. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:06:30.370087 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] [instance: 54675b80-4534-4379-90a4-b303f1b6a745] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:06:30.371070 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:06:30.371499 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:06:30.443079 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] [instance: 54675b80-4534-4379-90a4-b303f1b6a745] block_device_mapping [BlockDeviceMapping(attachment_id=ce1a2a6c-5732-457d-a315-fbe6207c5439,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edca611e-434f-4df1-a7b8-be681ceb1840',volume_size=1,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:06:30.444358 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:06:30.444932 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:06:30.698758 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:06:30.699130 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e07ad875-b136-4733-a456-ddd0853ccb9b tempest-TestVolumeBackupRestore-242122746 tempest-TestVolumeBackupRestore-242122746-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:06:44.442888 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:06:46.757320 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-fa90ad75-2454-466f-97a1-365d8c9ab963 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method rebuild_instance {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 03:06:46.757927 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-fa90ad75-2454-466f-97a1-365d8c9ab963 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:06:46.758221 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-fa90ad75-2454-466f-97a1-365d8c9ab963 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:06:46.844728 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-fa90ad75-2454-466f-97a1-365d8c9ab963 tempest-TestNetworkAdvancedServerOps-217544349 tempest-TestNetworkAdvancedServerOps-217544349-project] [instance: b0e6ef29-cdde-454f-a3a9-3d996e6baa35] No migration record for the rebuild/evacuate request. {{(pid=101511) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Aug 27 03:07:09.398927 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:07:10.416249 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60210. Aug 27 03:08:09.102025 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:08:10.121422 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60442. Aug 27 03:08:56.866153 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:08:57.883643 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32838. Aug 27 03:09:03.724201 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:09:04.740499 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32852. Aug 27 03:09:25.822873 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:09:25.844869 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:09:26.843145 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32900. Aug 27 03:09:26.868579 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32902. Aug 27 03:09:51.172700 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:10:04.459893 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:10:10.417121 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:10:11.433119 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32992. Aug 27 03:11:10.122583 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:11:11.138570 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33116. Aug 27 03:11:56.920607 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:11:57.883969 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:11:58.900434 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33222. Aug 27 03:11:59.065602 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:12:03.767203 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:12:04.742272 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:12:05.758208 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33244. Aug 27 03:12:05.917031 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:12:26.839923 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:12:26.862725 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:12:27.860704 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33284. Aug 27 03:12:27.883457 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33286. Aug 27 03:13:11.188270 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:13:11.434037 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:13:12.450278 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33292. Aug 27 03:13:24.476112 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:14:11.140844 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:14:12.156644 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33306. Aug 27 03:14:53.252316 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:14:53.273106 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:14:53.273545 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:14:53.412032 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:14:53.412348 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:14:53.413133 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:14:53.413555 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:14:53.428055 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Getting quotas for project e52baf076f654341ac2520f06cf811a5. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:14:53.432615 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Getting quotas for user fba4645bc958441895436ef5529c3cd0 and project e52baf076f654341ac2520f06cf811a5. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:14:53.443503 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] [instance: 5efaa74b-b147-4a90-9b28-7099406a0b95] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:14:53.444502 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:14:53.444901 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:14:53.503591 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] [instance: 5efaa74b-b147-4a90-9b28-7099406a0b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:14:53.504827 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:14:53.505232 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:14:53.688758 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:14:53.694706 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f225733e-0b3c-429d-b8cf-b6530588bc7c tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:15:05.759940 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:15:06.107081 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-7360de26-2f5c-4e3e-b127-4ec68c14a52f tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method rebuild_instance {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 03:15:06.107592 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7360de26-2f5c-4e3e-b127-4ec68c14a52f tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:15:06.107993 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-7360de26-2f5c-4e3e-b127-4ec68c14a52f tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:15:06.193634 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-7360de26-2f5c-4e3e-b127-4ec68c14a52f tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] [instance: 5efaa74b-b147-4a90-9b28-7099406a0b95] No migration record for the rebuild/evacuate request. {{(pid=101512) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Aug 27 03:15:06.219846 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7360de26-2f5c-4e3e-b127-4ec68c14a52f tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] [9a39423f-7be0-4d12-9c7b-3fb61a280d67] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:15:06.778125 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33550. Aug 27 03:15:07.234655 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [None req-7360de26-2f5c-4e3e-b127-4ec68c14a52f tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] [9a39423f-7be0-4d12-9c7b-3fb61a280d67] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33552. Aug 27 03:15:23.783293 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:15:45.137681 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:15:45.157108 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:15:45.157542 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:15:45.251204 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:15:45.251575 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:15:45.252312 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:15:45.252706 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:15:45.267686 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Getting quotas for project e52baf076f654341ac2520f06cf811a5. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:15:45.272095 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Getting quotas for user fba4645bc958441895436ef5529c3cd0 and project e52baf076f654341ac2520f06cf811a5. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:15:45.283081 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] [instance: 78577ece-5662-4c25-9fe3-360ff613b2be] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:15:45.284015 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:15:45.284421 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:15:45.331286 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] [instance: 78577ece-5662-4c25-9fe3-360ff613b2be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:15:45.332587 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:15:45.333046 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:15:45.498535 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:15:45.498942 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-06d7459a-e72f-43da-92fd-d070916384e2 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:15:57.352763 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-35d6ef0b-8b77-4124-a3e9-ece8166618b0 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method rebuild_instance {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 03:15:57.353240 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-35d6ef0b-8b77-4124-a3e9-ece8166618b0 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:15:57.353669 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-35d6ef0b-8b77-4124-a3e9-ece8166618b0 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:15:57.438522 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-35d6ef0b-8b77-4124-a3e9-ece8166618b0 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] [instance: 78577ece-5662-4c25-9fe3-360ff613b2be] No migration record for the rebuild/evacuate request. {{(pid=101512) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1129}} Aug 27 03:16:12.451591 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:16:13.467523 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33748. Aug 27 03:16:31.204232 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:16:34.181182 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:16:34.201871 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:34.202202 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:34.310081 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:34.310488 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:34.311224 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:34.311619 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:34.330844 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Getting quotas for project e52baf076f654341ac2520f06cf811a5. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:16:34.335687 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Getting quotas for user fba4645bc958441895436ef5529c3cd0 and project e52baf076f654341ac2520f06cf811a5. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:16:34.347312 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] [instance: 951423b7-13ed-4baf-8492-07350018d248] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:16:34.348314 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:34.349016 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:34.445813 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] [instance: 951423b7-13ed-4baf-8492-07350018d248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:16:34.447083 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:34.447492 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:34.806817 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:34.807146 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-f7ad1f8a-3248-4f1b-b028-6e3e5ffa5ac4 tempest-ServerDiskConfigTestJSON-514438695 tempest-ServerDiskConfigTestJSON-514438695-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:55.564154 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:16:55.594714 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:55.594714 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:55.832966 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:55.834824 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:55.836473 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:55.837336 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:55.863340 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Getting quotas for project 4f82ffc4cd514df0b4e52edf8e6d16a0. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:16:55.873410 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Getting quotas for user 86f006e442af4fa6b9ae95dd642c4d09 and project 4f82ffc4cd514df0b4e52edf8e6d16a0. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:16:55.898165 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] [instance: fca156ef-e407-4d89-b077-fea2008d269a] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:16:55.899300 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:55.899807 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:55.976603 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] [instance: fca156ef-e407-4d89-b077-fea2008d269a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:16:55.977813 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:55.978218 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:56.266780 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:56.267182 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a4a1ef7c-a0eb-438d-90b6-16b5059da24a tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:56.578211 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:16:56.602959 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:56.605719 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:56.777126 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:56.777936 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:56.778669 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:56.779060 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:56.796136 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Getting quotas for project 4f82ffc4cd514df0b4e52edf8e6d16a0. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:16:56.800959 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Getting quotas for user 86f006e442af4fa6b9ae95dd642c4d09 and project 4f82ffc4cd514df0b4e52edf8e6d16a0. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:16:56.828502 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] [instance: 89bab838-0d7c-49ae-a0dd-26678206e0da] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:16:56.829504 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:56.829891 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:56.913379 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] [instance: 89bab838-0d7c-49ae-a0dd-26678206e0da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:16:56.914700 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:56.915108 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:57.172026 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:57.172430 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-236192c2-243d-4d97-97b9-fcdf97ff6ba6 tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:57.294240 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:16:57.314286 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:57.314540 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:57.439455 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:57.440059 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:57.440846 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:57.441235 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:57.459367 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Getting quotas for project 4f82ffc4cd514df0b4e52edf8e6d16a0. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:16:57.464366 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Getting quotas for user 86f006e442af4fa6b9ae95dd642c4d09 and project 4f82ffc4cd514df0b4e52edf8e6d16a0. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:16:57.476081 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] [instance: 7d87c408-639b-46fb-a752-fb023e39ddf0] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:16:57.477021 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:57.477424 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:57.539624 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] [instance: 7d87c408-639b-46fb-a752-fb023e39ddf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:16:57.540995 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:57.541317 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:16:57.832544 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:16:57.832955 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-2b7b5d71-0a04-46f3-9648-16e34185bf0e tempest-ListServerFiltersTestJSON-1446068772 tempest-ListServerFiltersTestJSON-1446068772-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:17:12.157840 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:17:13.174677 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 34078. Aug 27 03:18:04.462872 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:18:04.481745 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:18:04.482153 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:18:04.625137 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:18:04.625478 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:18:04.626191 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:18:04.626576 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:18:04.640737 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Getting quotas for project 59c6bb017e814decbc972180dffc4e47. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:18:04.645104 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Getting quotas for user f2cbd3e9907e4c61b8a1cd79ce7dacea and project 59c6bb017e814decbc972180dffc4e47. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:18:04.658131 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] [instance: ec90a1b6-316a-4650-883a-6b7f2a53f676] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:18:04.658131 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:18:04.658421 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:18:04.730043 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] [instance: ec90a1b6-316a-4650-883a-6b7f2a53f676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:18:04.731278 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:18:04.731676 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:18:05.021984 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:18:05.022377 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-bde1c170-5ce5-413f-a042-4c17d19421c1 tempest-ServerTagsTestJSON-259171083 tempest-ServerTagsTestJSON-259171083-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:18:24.494210 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:19:06.780920 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:19:07.797501 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35018. Aug 27 03:19:13.469582 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:19:14.487716 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35076. Aug 27 03:19:27.883852 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:19:28.908642 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35364. Aug 27 03:19:51.221524 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:20:13.175945 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:20:14.192381 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35602. Aug 27 03:20:27.861948 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:20:28.883519 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35658. Aug 27 03:20:58.908785 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:20:59.925739 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35954. Aug 27 03:21:26.171871 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] [83ef34e2-dfe9-4263-821f-295a8d29f077] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:21:27.186583 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] [83ef34e2-dfe9-4263-821f-295a8d29f077] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36208. Aug 27 03:21:29.610668 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Took 3.44 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:21:29.629809 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:29.630210 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:29.849323 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:29.849775 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:29.850517 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:29.850918 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:29.866539 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Getting quotas for project 089bce5e23824383ba9728e41cbcb929. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:21:29.871085 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Getting quotas for user c22f73cf86ac4835afb70408ada88957 and project 089bce5e23824383ba9728e41cbcb929. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:21:29.881710 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] [instance: 77030496-893e-41f1-acc4-8bc5061a1039] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:21:29.882756 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:29.883160 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:29.948655 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] [instance: 77030496-893e-41f1-acc4-8bc5061a1039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:21:29.949948 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:29.950419 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:30.207256 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:30.207666 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:30.216767 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] [9a39423f-7be0-4d12-9c7b-3fb61a280d67] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:21:31.231978 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [None req-79deedf9-63df-4609-a0cd-0b581258699d tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] [9a39423f-7be0-4d12-9c7b-3fb61a280d67] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36236. Aug 27 03:21:44.510063 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:21:51.118627 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:21:51.140880 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:51.141282 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:51.227453 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:51.227859 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:51.228586 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:51.228980 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:51.243605 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Getting quotas for project 089bce5e23824383ba9728e41cbcb929. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:21:51.248030 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Getting quotas for user c22f73cf86ac4835afb70408ada88957 and project 089bce5e23824383ba9728e41cbcb929. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:21:51.259117 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] [instance: c259482d-fe3c-421e-b755-f61ef45bd0f0] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:21:51.260076 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:51.260488 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:51.308199 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] [instance: c259482d-fe3c-421e-b755-f61ef45bd0f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:21:51.309431 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:51.309863 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:21:51.498628 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:21:51.499027 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-40750fe3-c8a2-4f37-b7c7-f920866ebac8 tempest-VolumesActionsTest-1609017821 tempest-VolumesActionsTest-1609017821-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:22:14.488743 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:22:15.506939 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36456. Aug 27 03:22:50.881028 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:22:50.899968 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:22:50.900370 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:22:51.141411 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:22:51.141769 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:22:51.142491 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:22:51.142880 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:22:51.157204 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Getting quotas for project f307c4308ec74169996237d70b19600b. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:22:51.161729 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Getting quotas for user 001e2d7673de4dc1a036906bad403cac and project f307c4308ec74169996237d70b19600b. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:22:51.173868 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] [instance: 253dc7ca-244e-4c79-afb3-9b97224bc892] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:22:51.174781 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:22:51.175175 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:22:51.250221 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] [instance: 253dc7ca-244e-4c79-afb3-9b97224bc892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:22:51.251481 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:22:51.251878 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:22:51.540236 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:22:51.540636 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-bd0ee728-b5df-454e-b8ef-57de25848e5d tempest-TestServerAdvancedOps-217977973 tempest-TestServerAdvancedOps-217977973-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:23:11.239631 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:23:14.193793 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:23:15.215655 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36838. Aug 27 03:23:37.837607 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:23:37.855862 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:23:37.856266 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:23:38.045833 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:23:38.046239 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:23:38.046972 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:23:38.047367 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:23:38.063329 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:23:38.067927 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for user 5af0c747d47a47ec8a2cb14b8f911a3e and project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:23:38.078567 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: e40a1bf0-9400-4796-8da6-f6f9790486dd] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:23:38.079513 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:23:38.079834 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:23:38.143060 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: e40a1bf0-9400-4796-8da6-f6f9790486dd] block_device_mapping [BlockDeviceMapping(attachment_id=8c7ade76-45c3-4eae-a7ce-6075b8acb12f,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='022e2032-b453-4c2e-9e33-53a547aab4c2',volume_size=1,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:23:38.144421 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:23:38.145130 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:23:38.402070 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:23:38.402070 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-6b765bfe-ad29-45f8-9005-22eb7b943b2c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:24:37.704909 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:24:37.722969 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:24:37.723375 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:24:37.801230 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:24:37.801603 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:24:37.802311 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:24:37.802704 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:24:37.816991 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:24:37.821364 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for user 5af0c747d47a47ec8a2cb14b8f911a3e and project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:24:37.831732 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 69b12b26-5a82-459b-8470-00c9d96fd317] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:24:37.832641 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:24:37.833045 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:24:37.877561 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 69b12b26-5a82-459b-8470-00c9d96fd317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4a5f90f6-f0ee-4de7-a207-93807b12f945',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:24:37.878790 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:24:37.879190 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:24:38.033403 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:24:38.033857 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-d45d3f6d-042e-4d61-9f83-4afa312ff39c tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:25:04.526614 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:25:15.508582 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:25:16.526095 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37322. Aug 27 03:25:58.613495 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [fa54404d-3f69-4115-b41d-a1ddfae51ae5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:25:59.627293 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [fa54404d-3f69-4115-b41d-a1ddfae51ae5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37548. Aug 27 03:25:59.928023 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:26:00.945205 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37562. Aug 27 03:26:01.897826 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Took 3.29 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:26:01.916777 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:01.917184 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:02.051183 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:02.051791 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:02.052298 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:02.052690 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:02.067415 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:26:02.071775 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for user 5af0c747d47a47ec8a2cb14b8f911a3e and project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:26:02.082566 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 6ee36f7b-f700-48c6-90be-6dfbc92557bd] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:26:02.083444 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:02.083848 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:02.142917 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 6ee36f7b-f700-48c6-90be-6dfbc92557bd] block_device_mapping [BlockDeviceMapping(attachment_id=7191935b-1e8c-47ab-bb72-04ce66cfd1b2,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08e1100d-9e7c-4b23-8337-d6f40e8cd624',volume_size=1,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:26:02.144109 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:02.144514 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:02.384028 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:02.384432 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-de13005c-3918-4707-bf5b-63985bea2cee tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:15.216366 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:26:16.232475 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37608. Aug 27 03:26:27.151549 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:26:27.170755 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:27.171160 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:27.375439 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:27.375867 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:27.377173 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:27.377665 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:27.392669 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:26:27.397302 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for user 5af0c747d47a47ec8a2cb14b8f911a3e and project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:26:27.407981 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 4e31673c-3fef-4850-a87e-1312ff104bca] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:26:27.408887 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:27.409293 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:27.474578 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 4e31673c-3fef-4850-a87e-1312ff104bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ef80362b-6d0f-48c8-9fdd-f62bf5d29eb4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:26:27.475869 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:27.476304 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:27.716285 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:26:27.716612 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec8-b510-4c3c-82e6-d65caafda6e2 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:26:31.256975 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:28:14.906449 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:28:14.930531 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:28:14.930947 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:28:15.042205 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:28:15.042205 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:28:15.042205 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:28:15.042827 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:28:15.062036 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:28:15.066731 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for user 5af0c747d47a47ec8a2cb14b8f911a3e and project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:28:15.077502 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 383d62fe-b1a0-49c2-8128-b2e42e0334cb] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:28:15.078442 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:28:15.078846 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:28:15.223352 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 383d62fe-b1a0-49c2-8128-b2e42e0334cb] block_device_mapping [BlockDeviceMapping(attachment_id=1aaa5d5b-e849-4528-90eb-e0743d7a4968,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95fa5c3b-e6de-4968-ab6e-089233dfe1ff',volume_size=1,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:28:15.224705 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:28:15.225116 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:28:15.443319 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:28:15.443757 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-8c5992a8-a8ae-4845-add1-4d26f986fa1a tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:28:16.526806 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:28:17.544400 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38196. Aug 27 03:28:24.545109 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:28:28.908825 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:28:29.931020 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38226. Aug 27 03:28:43.809271 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:28:45.949282 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:29:07.805723 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:29:08.820689 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38276. Aug 27 03:29:16.234880 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:29:17.251840 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38280. Aug 27 03:29:51.273264 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:30:28.887865 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:30:29.927095 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38314. Aug 27 03:31:00.954090 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:31:01.985680 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38320. Aug 27 03:31:16.015987 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:31:16.044775 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.045230 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.366644 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.367348 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.368580 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.369228 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.399627 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:31:16.407501 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for user 5af0c747d47a47ec8a2cb14b8f911a3e and project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:31:16.425161 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 0c548249-9a40-4342-bb35-5c0884af82cc] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:31:16.426597 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.427252 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:16.607152 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 0c548249-9a40-4342-bb35-5c0884af82cc] block_device_mapping [BlockDeviceMapping(attachment_id=6b1330a9-a2a1-4e01-91b8-153cec744b4b,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95fa5c3b-e6de-4968-ab6e-089233dfe1ff',volume_size=1,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:31:16.609223 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:16.610452 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.077960 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:31:17.079036 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-cf853984-325d-422f-81a6-acf853750954 tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:31:17.545637 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:31:18.571112 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38404. Aug 27 03:31:44.561592 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:32:17.253089 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:32:18.271773 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38472. Aug 27 03:33:11.291069 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:33:29.915192 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:33:29.929187 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:33:30.939454 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38504. Aug 27 03:33:30.954641 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38506. Aug 27 03:33:36.956764 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:33:39.099278 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:33:43.828380 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:33:45.967845 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:34:01.987369 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:34:03.006438 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38562. Aug 27 03:34:08.824147 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:34:09.844328 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38578. Aug 27 03:34:18.575394 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:34:19.592520 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38600. Aug 27 03:34:26.599383 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:34:26.621523 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.621928 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.768356 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.768750 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.769502 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.769900 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.786202 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:34:26.791370 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Getting quotas for user 5af0c747d47a47ec8a2cb14b8f911a3e and project f239d6942cc94f8ba7f24c450f4108f1. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:34:26.802167 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 2b5d1122-415e-4922-ad19-ac271d4e3d87] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:34:26.803101 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.803505 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:26.907327 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] [instance: 2b5d1122-415e-4922-ad19-ac271d4e3d87] block_device_mapping [BlockDeviceMapping(attachment_id=377d795c-e2e5-4ea4-ab6c-631a500fbaf5,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11be73be-80a2-4004-8e26-d525a29b9c1a',volume_size=1,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:34:26.908532 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:26.908941 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:34:27.232743 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:34:27.233178 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e27e0afd-3186-4e76-b68a-649a4db5dd0d tempest-TestVolumeBootPattern-1809887111 tempest-TestVolumeBootPattern-1809887111-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:35:04.580816 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:35:18.270895 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:35:19.292985 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38718. Aug 27 03:36:30.934189 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:36:30.948697 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:36:31.316375 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:36:31.959644 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38742. Aug 27 03:36:31.976364 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38744. Aug 27 03:36:56.972853 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:36:59.117748 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:37:03.007027 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:37:03.845584 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:37:04.022273 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38770. Aug 27 03:37:05.985018 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:37:09.845970 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:37:10.863406 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38778. Aug 27 03:37:19.593433 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:37:20.610266 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38782. Aug 27 03:38:15.529595 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:38:15.559924 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:15.560575 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:15.791175 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:15.791520 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:15.792305 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:15.792700 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:15.807769 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Getting quotas for project c67860093f5b4febb8bc5b6c9df43c5c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:38:15.812340 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Getting quotas for user 19278ed6fd804ee5aa5eda20b25ed103 and project c67860093f5b4febb8bc5b6c9df43c5c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:38:15.822762 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] [instance: c2c83b2e-a50e-4835-b993-9d9471966ff9] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:38:15.823696 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:15.824101 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:15.936855 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] [instance: c2c83b2e-a50e-4835-b993-9d9471966ff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:38:15.938185 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:15.938981 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:16.283231 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:16.284469 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-a8622f11-9746-42cb-ba75-d085f7eb1373 tempest-ServersAdminNegativeTestJSON-1223134938 tempest-ServersAdminNegativeTestJSON-1223134938-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:19.292864 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:38:20.310992 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39002. Aug 27 03:38:24.598491 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:38:41.955922 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:38:41.974710 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:41.975111 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:42.267267 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:42.267666 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:42.268464 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:42.268863 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:42.283926 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Getting quotas for project ae49ce577f70469092840e2607390a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:38:42.288275 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Getting quotas for user e399e529993642ad9b69654a4cf23deb and project ae49ce577f70469092840e2607390a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:38:42.298931 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] [instance: c737defa-bd7b-4fac-b9c4-6703b7f61804] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:38:42.299869 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:42.300285 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:42.416631 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] [instance: c737defa-bd7b-4fac-b9c4-6703b7f61804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:38:42.417924 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:42.418329 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:42.716989 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:42.717413 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6c41d093-0b79-4bfe-bc21-5a9cec8f43e1 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:56.897183 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 03:38:56.897729 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:38:56.898105 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:38:57.220438 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] [instance: c737defa-bd7b-4fac-b9c4-6703b7f61804] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101511) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 03:38:57.757340 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Created allocations for migration b915da8c-4f06-4885-bd66-f6c2bba1bcc8 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101511) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 03:38:58.026538 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] [instance: c737defa-bd7b-4fac-b9c4-6703b7f61804] Calling prep_resize with selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [Selection(allocation_request='{"allocations": {"6e12de08-5d57-48b3-b442-9a192ba4e475": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["6e12de08-5d57-48b3-b442-9a192ba4e475"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=d68f2037-da7b-424a-bde4-8ae09fc2781e,compute_node_uuid=6e12de08-5d57-48b3-b442-9a192ba4e475,limits=SchedulerLimits,nodename='n-h1-802225-4',service_host='n-h1-802225-4')] {{(pid=101511) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 03:38:58.278211 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.client.report [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Overwriting current allocation {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 203}}, 'project_id': 'ae49ce577f70469092840e2607390a8d', 'user_id': 'e399e529993642ad9b69654a4cf23deb', 'consumer_generation': 1} on consumer c737defa-bd7b-4fac-b9c4-6703b7f61804 {{(pid=101511) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 03:38:58.437320 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Created allocations for instance c737defa-bd7b-4fac-b9c4-6703b7f61804 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101511) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 03:38:58.468534 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.utils [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 03:38:58.469710 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.utils [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] [instance: c737defa-bd7b-4fac-b9c4-6703b7f61804] Setting instance to ACTIVE state. Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server [None req-5e527c88-3b6d-4694-bb55-3c2526d71d65 tempest-DeleteServersTestJSON-1162362159 tempest-DeleteServersTestJSON-1162362159-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 03:38:58.789164 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 03:38:58.790559 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 03:38:58.792118 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 03:38:58.792118 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Aug 27 03:40:20.614173 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:40:21.629740 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39374. Aug 27 03:41:04.025072 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:41:05.041136 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39464. Aug 27 03:41:10.865124 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:41:11.881446 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39478. Aug 27 03:41:20.310852 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:41:21.328098 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39496. Aug 27 03:41:31.334458 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:41:31.957633 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:41:31.974176 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:41:32.978960 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39524. Aug 27 03:41:32.999624 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39526. Aug 27 03:41:44.615669 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:41:57.004770 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:43:21.630627 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:43:22.646949 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39748. Aug 27 03:43:39.137132 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:43:43.865142 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:43:46.036821 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:44:05.042734 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:44:06.059932 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39858. Aug 27 03:44:11.883736 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:44:12.900921 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39872. Aug 27 03:44:21.328508 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:44:22.345010 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39890. Aug 27 03:44:32.975026 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:44:32.995729 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:44:33.996290 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39916. Aug 27 03:44:34.017751 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39918. Aug 27 03:44:51.352302 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:45:04.632442 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:45:05.880212 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [fa54404d-3f69-4115-b41d-a1ddfae51ae5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:45:06.896518 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [fa54404d-3f69-4115-b41d-a1ddfae51ae5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40044. Aug 27 03:45:09.295785 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Took 3.43 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:45:09.316899 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:45:09.317303 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:45:09.490049 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:45:09.490456 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:45:09.491200 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:45:09.491597 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:45:09.506772 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Getting quotas for project d29f8d8069794551af42f17919bbaf3c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:45:09.511327 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Getting quotas for user f56731b90d0c40cc8d085c8da1555e6f and project d29f8d8069794551af42f17919bbaf3c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:45:09.521747 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [instance: c4f8258e-c275-4318-9e66-a4ceec58e492] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:45:09.522652 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:45:09.523053 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:45:09.605099 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [instance: c4f8258e-c275-4318-9e66-a4ceec58e492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:45:09.606949 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:45:09.607343 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:45:09.818336 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:45:09.818738 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d097b227-61d4-4228-9819-cbc479aa0c1c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:45:22.752619 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 03:45:22.752619 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:45:22.753120 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:45:23.015458 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [instance: c4f8258e-c275-4318-9e66-a4ceec58e492] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101512) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 03:45:23.430559 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Created allocations for migration 9629b6f5-f1db-4852-ae78-0a8de7f6ea1d on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 03:45:23.719759 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [instance: c4f8258e-c275-4318-9e66-a4ceec58e492] Calling prep_resize with selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [Selection(allocation_request='{"allocations": {"6e12de08-5d57-48b3-b442-9a192ba4e475": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["6e12de08-5d57-48b3-b442-9a192ba4e475"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=d68f2037-da7b-424a-bde4-8ae09fc2781e,compute_node_uuid=6e12de08-5d57-48b3-b442-9a192ba4e475,limits=SchedulerLimits,nodename='n-h1-802225-4',service_host='n-h1-802225-4')] {{(pid=101512) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 03:45:23.950290 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.client.report [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Overwriting current allocation {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 204}}, 'project_id': 'd29f8d8069794551af42f17919bbaf3c', 'user_id': 'f56731b90d0c40cc8d085c8da1555e6f', 'consumer_generation': 1} on consumer c4f8258e-c275-4318-9e66-a4ceec58e492 {{(pid=101512) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 03:45:24.076177 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Created allocations for instance c4f8258e-c275-4318-9e66-a4ceec58e492 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 03:45:24.103588 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 03:45:24.104709 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [instance: c4f8258e-c275-4318-9e66-a4ceec58e492] Setting instance to ACTIVE state. Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server [None req-8df1aeac-0bda-4580-b059-f0fdb1595a3c tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 03:45:24.336548 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 03:45:24.337906 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 03:45:24.339938 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 03:45:24.339938 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Aug 27 03:46:22.649098 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:46:23.666454 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40260. Aug 27 03:47:06.052316 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:47:22.347667 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:47:23.365134 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40384. Aug 27 03:47:33.992909 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:47:34.012795 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:47:35.016843 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40412. Aug 27 03:47:35.033969 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40416. Aug 27 03:48:06.061334 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:48:07.076050 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40478. Aug 27 03:48:11.369099 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:48:12.903897 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:48:13.921059 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40496. Aug 27 03:48:24.661905 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:49:23.667117 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:49:24.685071 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40634. Aug 27 03:50:17.027363 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:50:19.157005 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:50:23.364883 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:50:23.884757 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:50:24.380365 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40770. Aug 27 03:50:26.068875 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:50:35.009982 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:50:35.028747 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:50:36.031576 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40800. Aug 27 03:50:36.048762 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40802. Aug 27 03:51:07.077667 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:51:08.093879 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40866. Aug 27 03:51:13.922739 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:51:14.940884 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40882. Aug 27 03:51:24.132417 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:51:24.153607 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:24.154007 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:24.272634 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:24.273035 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:24.273801 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:24.274192 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:24.290050 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Getting quotas for project d29f8d8069794551af42f17919bbaf3c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:51:24.294669 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Getting quotas for user f56731b90d0c40cc8d085c8da1555e6f and project d29f8d8069794551af42f17919bbaf3c. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:51:24.306584 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [instance: e00bb25c-c1ad-47bb-9132-6086b7faa28f] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:51:24.307543 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:24.307954 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:24.381177 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [instance: e00bb25c-c1ad-47bb-9132-6086b7faa28f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:51:24.382420 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:24.382860 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:24.662649 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:24.662961 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-3f573bc7-8180-4cc5-965b-2f31f505644f tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:31.385722 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:51:35.845026 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 03:51:35.845538 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:51:35.845907 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:51:36.122851 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [instance: e00bb25c-c1ad-47bb-9132-6086b7faa28f] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101512) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 03:51:36.628880 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Created allocations for migration b15fdbc9-328b-44c8-bfea-893e22e2f905 on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 03:51:36.922647 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [instance: e00bb25c-c1ad-47bb-9132-6086b7faa28f] Calling prep_resize with selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [Selection(allocation_request='{"allocations": {"8f1d7267-4d7c-4650-83e0-62766d0c0a07": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8f1d7267-4d7c-4650-83e0-62766d0c0a07"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=d68f2037-da7b-424a-bde4-8ae09fc2781e,compute_node_uuid=8f1d7267-4d7c-4650-83e0-62766d0c0a07,limits=SchedulerLimits,nodename='n-h2-802225-4',service_host='n-h2-802225-4')] {{(pid=101512) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 03:51:37.149679 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.client.report [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Overwriting current allocation {'allocations': {'6e12de08-5d57-48b3-b442-9a192ba4e475': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 180}}, 'project_id': 'd29f8d8069794551af42f17919bbaf3c', 'user_id': 'f56731b90d0c40cc8d085c8da1555e6f', 'consumer_generation': 1} on consumer e00bb25c-c1ad-47bb-9132-6086b7faa28f {{(pid=101512) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 03:51:37.303615 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Created allocations for instance e00bb25c-c1ad-47bb-9132-6086b7faa28f on 8f1d7267-4d7c-4650-83e0-62766d0c0a07 {{(pid=101512) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 03:51:37.330708 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 03:51:37.331872 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [instance: e00bb25c-c1ad-47bb-9132-6086b7faa28f] Setting instance to ACTIVE state. Aug 27 03:51:37.484665 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [6ca94fa5-8c83-4a6e-9cd1-928d12f56f80] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:51:38.499413 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] [6ca94fa5-8c83-4a6e-9cd1-928d12f56f80] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41016. Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server [None req-c1f69d99-8afe-467b-86c6-90973bd553ea tempest-ServerDiskConfigTestJSON-996062592 tempest-ServerDiskConfigTestJSON-996062592-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 03:51:38.718337 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 03:51:38.719679 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 03:51:38.721102 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 03:51:38.721102 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Aug 27 03:52:24.684857 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:52:25.701668 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41100. Aug 27 03:53:24.381635 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:53:25.398688 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41222. Aug 27 03:53:36.028819 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:53:36.045567 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:53:37.051316 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41250. Aug 27 03:53:37.070198 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41252. Aug 27 03:53:46.085698 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:54:08.094929 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:54:09.111163 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41318. Aug 27 03:54:14.942797 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:54:15.960410 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41336. Aug 27 03:54:51.402263 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:55:25.702686 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:55:26.718342 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41478. Aug 27 03:56:25.401737 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:56:26.418308 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41596. Aug 27 03:56:37.047133 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:56:37.064808 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:56:38.071679 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41622. Aug 27 03:56:38.087397 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41624. Aug 27 03:56:44.683576 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:56:57.047372 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:56:59.177289 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:57:03.908348 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:57:06.108805 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:57:09.112575 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:57:10.129649 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41706. Aug 27 03:57:15.961912 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:57:16.978557 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41720. Aug 27 03:57:50.419560 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 03:57:50.438602 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:57:50.439003 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:57:50.670132 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:57:50.670440 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:57:50.671173 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:57:50.671570 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:57:50.687220 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Getting quotas for project 6f23bcad932641a38713513b613372cb. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 03:57:50.692573 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Getting quotas for user 733944cfda614efcb63df9528f137b3d and project 6f23bcad932641a38713513b613372cb. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 03:57:50.703532 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 636909f0-1a29-43e1-b8fd-a4ebc16eb3ac] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 03:57:50.704531 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:57:50.704941 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:57:50.801571 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 636909f0-1a29-43e1-b8fd-a4ebc16eb3ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 03:57:50.802852 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:57:50.803264 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:57:51.095999 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:57:51.096526 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-7a41b3d4-41b7-44a2-a1ea-d221f42c73bc tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:58:11.418923 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:58:26.719712 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:58:27.734774 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41960. Aug 27 03:59:26.419633 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 03:59:27.436104 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42084. Aug 27 03:59:38.082138 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:59:39.103779 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42108. Aug 27 04:00:04.701075 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:00:10.130926 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:00:11.147244 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42172. Aug 27 04:00:16.978909 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:00:17.062646 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:00:17.995255 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42202. Aug 27 04:00:19.194212 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:00:23.924697 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:00:26.117019 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:00:32.216360 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 04:00:32.216875 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:00:32.217227 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:00:32.460446 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 636909f0-1a29-43e1-b8fd-a4ebc16eb3ac] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101511) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 04:00:32.933887 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Created allocations for migration 3a1aae4f-8ffc-47cc-a13b-eac18e9edeb4 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101511) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 04:00:33.222308 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 636909f0-1a29-43e1-b8fd-a4ebc16eb3ac] Calling prep_resize with selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [Selection(allocation_request='{"allocations": {"6e12de08-5d57-48b3-b442-9a192ba4e475": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["6e12de08-5d57-48b3-b442-9a192ba4e475"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=d68f2037-da7b-424a-bde4-8ae09fc2781e,compute_node_uuid=6e12de08-5d57-48b3-b442-9a192ba4e475,limits=SchedulerLimits,nodename='n-h1-802225-4',service_host='n-h1-802225-4')] {{(pid=101511) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 04:00:33.435842 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.client.report [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Overwriting current allocation {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 209}}, 'project_id': '6f23bcad932641a38713513b613372cb', 'user_id': '733944cfda614efcb63df9528f137b3d', 'consumer_generation': 1} on consumer 636909f0-1a29-43e1-b8fd-a4ebc16eb3ac {{(pid=101511) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 04:00:33.563510 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Created allocations for instance 636909f0-1a29-43e1-b8fd-a4ebc16eb3ac on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101511) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 04:00:33.594637 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.utils [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:00:33.596124 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.utils [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 636909f0-1a29-43e1-b8fd-a4ebc16eb3ac] Setting instance to ACTIVE state. Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server [None req-79ab4a84-e9b8-4d76-b588-e4c668278b12 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 04:00:33.829006 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 04:00:33.830487 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 04:00:33.831931 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:00:33.831931 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Aug 27 04:01:27.736672 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:01:28.752684 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42392. Aug 27 04:02:27.436628 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:02:28.453659 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42504. Aug 27 04:02:38.069046 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:02:39.089475 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42530. Aug 27 04:02:39.100394 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:02:40.121408 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42534. Aug 27 04:03:11.149687 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:03:11.437870 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:03:12.164744 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42598. Aug 27 04:03:17.995699 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:03:19.011848 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42616. Aug 27 04:03:24.717875 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:03:37.078664 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:03:39.210467 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:03:43.955022 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:03:46.133859 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:04:28.754778 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:04:29.770889 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42776. Aug 27 04:05:28.456052 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:05:29.471444 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42890. Aug 27 04:05:39.085931 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:05:40.106592 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42914. Aug 27 04:05:40.118671 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:05:41.139873 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42918. Aug 27 04:06:12.166872 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:06:13.184979 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42982. Aug 27 04:06:19.013756 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:06:20.031636 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42996. Aug 27 04:06:31.454713 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:06:38.662378 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [fa54404d-3f69-4115-b41d-a1ddfae51ae5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:06:39.677130 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [fa54404d-3f69-4115-b41d-a1ddfae51ae5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43068. Aug 27 04:06:39.980143 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Took 1.32 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:06:39.999592 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:39.999993 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.093100 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.093540 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.094270 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.094663 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.113820 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Getting quotas for project 6f23bcad932641a38713513b613372cb. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:06:40.118786 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Getting quotas for user 733944cfda614efcb63df9528f137b3d and project 6f23bcad932641a38713513b613372cb. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:06:40.128897 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 4a86c4bf-a85d-4d0c-bdb8-fdfdbbc25dd3] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:06:40.129823 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.130224 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.192191 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 4a86c4bf-a85d-4d0c-bdb8-fdfdbbc25dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:06:40.194031 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.194434 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.393849 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.394264 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.403237 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [bfee31d1-a63e-4713-9878-52e341b6835f] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:06:41.419401 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [None req-e46ad3b0-ac2a-40ef-80af-d51a9115e402 tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [bfee31d1-a63e-4713-9878-52e341b6835f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43084. Aug 27 04:06:44.734135 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:07:03.970472 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:07:06.149391 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:07:29.771580 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:07:30.787573 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43144. Aug 27 04:07:58.829440 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:07:58.851764 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:58.852226 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:58.972397 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:58.972856 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:58.973703 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:58.974151 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:58.994149 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Getting quotas for project 6f23bcad932641a38713513b613372cb. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:07:58.998874 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Getting quotas for user 733944cfda614efcb63df9528f137b3d and project 6f23bcad932641a38713513b613372cb. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:07:59.010099 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 08967940-a9cb-4b5c-a3a1-f80a18140b02] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:07:59.011059 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:59.011485 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:59.111676 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 08967940-a9cb-4b5c-a3a1-f80a18140b02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:07:59.112982 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:59.113381 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:59.425561 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:59.425963 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-e1f47628-eb0d-4419-8c7e-e6aca846f09b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:29.472696 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:08:30.489248 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43266. Aug 27 04:08:40.102945 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:08:41.123467 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43290. Aug 27 04:09:13.184981 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:09:14.201226 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43358. Aug 27 04:09:51.470490 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:10:04.753144 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:10:20.033831 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:10:21.049767 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43496. Aug 27 04:10:23.986748 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:10:26.166742 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:10:30.788627 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:10:31.803877 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43524. Aug 27 04:10:37.686445 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 04:10:37.687065 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:37.687315 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:37.948800 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 08967940-a9cb-4b5c-a3a1-f80a18140b02] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101512) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 04:10:38.488144 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Created allocations for migration 274b7d91-d403-44b3-89f3-252cb4764282 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 04:10:38.772289 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 08967940-a9cb-4b5c-a3a1-f80a18140b02] Calling prep_resize with selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [Selection(allocation_request='{"allocations": {"8f1d7267-4d7c-4650-83e0-62766d0c0a07": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8f1d7267-4d7c-4650-83e0-62766d0c0a07"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=d68f2037-da7b-424a-bde4-8ae09fc2781e,compute_node_uuid=8f1d7267-4d7c-4650-83e0-62766d0c0a07,limits=SchedulerLimits,nodename='n-h2-802225-4',service_host='n-h2-802225-4')] {{(pid=101512) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 04:10:39.027288 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.client.report [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Overwriting current allocation {'allocations': {'6e12de08-5d57-48b3-b442-9a192ba4e475': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 187}}, 'project_id': '6f23bcad932641a38713513b613372cb', 'user_id': '733944cfda614efcb63df9528f137b3d', 'consumer_generation': 1} on consumer 08967940-a9cb-4b5c-a3a1-f80a18140b02 {{(pid=101512) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 04:10:39.202759 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Created allocations for instance 08967940-a9cb-4b5c-a3a1-f80a18140b02 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 04:10:39.228747 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:10:39.229908 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: 08967940-a9cb-4b5c-a3a1-f80a18140b02] Setting instance to ACTIVE state. Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server [None req-4381e36f-f767-4b2d-a160-7167549579ba tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 04:10:39.600943 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 04:10:39.602362 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 04:10:39.603737 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:10:39.603737 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Aug 27 04:11:30.490670 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:11:31.507343 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43680. Aug 27 04:11:41.120877 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:11:42.143055 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43700. Aug 27 04:11:57.100423 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:11:59.234378 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:12:14.204011 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:12:15.221135 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43764. Aug 27 04:12:41.141679 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:12:42.164437 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43818. Aug 27 04:13:11.486306 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:13:21.051915 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:13:22.069021 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43898. Aug 27 04:13:24.769161 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:13:31.805521 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:13:32.821828 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43926. Aug 27 04:13:44.004025 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:13:46.182759 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:14:31.510027 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:14:32.525405 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44054. Aug 27 04:14:42.138903 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:14:43.159736 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44082. Aug 27 04:15:15.222680 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:15:16.238692 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44140. Aug 27 04:15:17.117614 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:15:19.253199 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:15:42.159972 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:15:43.181035 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44200. Aug 27 04:16:22.070612 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:16:23.086298 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44274. Aug 27 04:16:31.501929 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:16:32.823610 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:16:33.838695 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44302. Aug 27 04:16:44.245782 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:16:44.265570 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:44.266002 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:44.409263 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:44.409619 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:44.410409 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:44.410797 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:44.425932 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Getting quotas for project 6f23bcad932641a38713513b613372cb. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:16:44.430917 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Getting quotas for user 733944cfda614efcb63df9528f137b3d and project 6f23bcad932641a38713513b613372cb. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:16:44.441369 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: f779aea1-84c7-4983-a08d-d9cc27cf2539] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:16:44.442954 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:44.443353 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:44.507946 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: f779aea1-84c7-4983-a08d-d9cc27cf2539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:16:44.509204 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:44.509673 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:44.732569 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:44.732980 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-76e9c873-ba7c-4eff-8302-ba6a3812083f tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:44.786369 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:17:04.022570 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:17:06.199085 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:17:32.526704 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:17:33.540935 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44510. Aug 27 04:18:43.178000 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:18:44.199823 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44660. Aug 27 04:19:16.241754 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:19:17.257668 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44726. Aug 27 04:19:23.088891 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:19:24.104224 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44742. Aug 27 04:19:33.839576 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:19:34.856073 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44792. Aug 27 04:19:43.158304 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:19:44.180118 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44818. Aug 27 04:19:47.092084 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 04:19:47.092671 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:47.093123 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:47.352555 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: f779aea1-84c7-4983-a08d-d9cc27cf2539] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101512) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 04:19:47.840369 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Created allocations for migration f1e181f3-a03a-4450-8e79-482c1a757350 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 04:19:48.112993 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: f779aea1-84c7-4983-a08d-d9cc27cf2539] Calling prep_resize with selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [Selection(allocation_request='{"allocations": {"8f1d7267-4d7c-4650-83e0-62766d0c0a07": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8f1d7267-4d7c-4650-83e0-62766d0c0a07"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=d68f2037-da7b-424a-bde4-8ae09fc2781e,compute_node_uuid=8f1d7267-4d7c-4650-83e0-62766d0c0a07,limits=SchedulerLimits,nodename='n-h2-802225-4',service_host='n-h2-802225-4')] {{(pid=101512) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 04:19:48.363938 n-d-802225-4 nova-conductor[101512]: DEBUG nova.scheduler.client.report [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Overwriting current allocation {'allocations': {'6e12de08-5d57-48b3-b442-9a192ba4e475': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 192}}, 'project_id': '6f23bcad932641a38713513b613372cb', 'user_id': '733944cfda614efcb63df9528f137b3d', 'consumer_generation': 1} on consumer f779aea1-84c7-4983-a08d-d9cc27cf2539 {{(pid=101512) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 04:19:48.535905 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.tasks.migrate [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Created allocations for instance f779aea1-84c7-4983-a08d-d9cc27cf2539 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101512) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 04:19:48.561708 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:19:48.562836 n-d-802225-4 nova-conductor[101512]: WARNING nova.scheduler.utils [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [instance: f779aea1-84c7-4983-a08d-d9cc27cf2539] Setting instance to ACTIVE state. Aug 27 04:19:48.753804 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [6ca94fa5-8c83-4a6e-9cd1-928d12f56f80] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:19:49.770607 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] [6ca94fa5-8c83-4a6e-9cd1-928d12f56f80] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44874. Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server [None req-8f5eac95-23e9-499d-814e-f852395e8d9b tempest-ServerActionsTestJSON-338211967 tempest-ServerActionsTestJSON-338211967-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 04:19:49.967738 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 04:19:49.969140 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 04:19:49.971542 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:19:49.971542 n-d-802225-4 nova-conductor[101512]: ERROR oslo_messaging.rpc.server Aug 27 04:19:51.518226 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:20:26.215551 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:20:33.542956 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:20:34.558586 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44964. Aug 27 04:21:57.138086 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:21:59.272445 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:22:04.039903 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:22:17.258883 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:22:18.274674 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45166. Aug 27 04:22:24.105965 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:22:25.123512 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45178. Aug 27 04:22:34.857566 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:22:35.874474 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45200. Aug 27 04:22:44.177064 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:22:44.196758 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:22:45.198415 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45224. Aug 27 04:22:45.216865 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45226. Aug 27 04:23:11.534059 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:23:34.560903 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:23:35.578100 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45326. Aug 27 04:23:46.231554 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:25:04.807606 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:25:17.154555 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:25:18.277032 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:25:19.288699 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:25:19.303313 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45534. Aug 27 04:25:24.056316 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:25:25.124229 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:25:26.147411 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45556. Aug 27 04:25:35.876701 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:25:36.892729 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45576. Aug 27 04:25:45.195974 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:25:45.214046 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:25:46.216566 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45610. Aug 27 04:25:46.237169 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45612. Aug 27 04:26:06.846559 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:26:06.865715 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:06.866121 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:07.068798 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:07.069123 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:07.069900 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:07.070293 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:07.085817 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Getting quotas for project eb653d1be17c406086b0bd81525f34f2. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:26:07.090708 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Getting quotas for user f66f4872fd794cc1bb03e9544d942e3e and project eb653d1be17c406086b0bd81525f34f2. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:26:07.101175 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] [instance: 4583d36b-6592-48a7-8745-84e6e4a5f17b] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:26:07.102103 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:07.102510 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:07.195137 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] [instance: 4583d36b-6592-48a7-8745-84e6e4a5f17b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:26:07.196395 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:07.196803 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:07.414364 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:07.414686 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-62e61405-c4e9-46e4-979c-8351af6f03f8 tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:21.441118 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:26:21.460030 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:21.460443 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:21.576745 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:21.577153 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:21.577938 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:21.578329 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:21.595390 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Getting quotas for project eb653d1be17c406086b0bd81525f34f2. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:26:21.599962 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Getting quotas for user f66f4872fd794cc1bb03e9544d942e3e and project eb653d1be17c406086b0bd81525f34f2. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:26:21.611196 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] [instance: 17a71faf-26e0-472f-846e-a071fbbba4b5] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:26:21.612142 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:21.612553 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:21.662985 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] [instance: 17a71faf-26e0-472f-846e-a071fbbba4b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:26:21.664254 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:21.664656 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:21.906070 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:21.906391 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6cc0205c-4b48-4312-8dac-3b0f87bf41ff tempest-ServersNegativeTestJSON-1714480376 tempest-ServersNegativeTestJSON-1714480376-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:31.551436 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:26:35.578976 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:26:36.598763 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45880. Aug 27 04:27:29.822203 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:27:29.843259 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:27:29.843660 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:27:30.181923 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:27:30.182575 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:27:30.183301 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:27:30.183691 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:27:30.207761 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Getting quotas for project 261ba694e8994e638ea461a8a22c6ff6. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:27:30.215753 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Getting quotas for user 9564161fcf164b37abe1c54f411ef023 and project 261ba694e8994e638ea461a8a22c6ff6. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:27:30.229181 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] [instance: 242a2e68-34de-47d6-96ef-81bea038b609] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:27:30.230479 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:27:30.231057 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:27:30.344253 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] [instance: 242a2e68-34de-47d6-96ef-81bea038b609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:27:30.344253 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:27:30.344253 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:27:30.736732 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:27:30.737145 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-d6eb5b92-4841-4814-a238-b34377778ada tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:13.664515 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:28:13.684379 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:28:13.684818 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:13.890026 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:28:13.890428 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:13.891144 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:28:13.891533 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:13.906646 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Getting quotas for project 261ba694e8994e638ea461a8a22c6ff6. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:28:13.911027 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Getting quotas for user 9564161fcf164b37abe1c54f411ef023 and project 261ba694e8994e638ea461a8a22c6ff6. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:28:13.921795 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] [instance: 542aa285-9eb0-4466-9d36-442acc7f8a84] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:28:13.922703 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:28:13.923095 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:13.998279 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] [instance: 542aa285-9eb0-4466-9d36-442acc7f8a84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:28:13.999522 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:28:13.999918 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:14.245530 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:28:14.245927 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-c5362046-b019-4cd9-b509-dee87a022f31 tempest-TestEncryptedCinderVolumes-2017312676 tempest-TestEncryptedCinderVolumes-2017312676-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:24.825704 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:28:36.894352 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:28:37.911000 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46398. Aug 27 04:29:32.769994 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:29:32.790820 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:29:32.791226 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:29:33.151468 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:29:33.151781 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:29:33.152542 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:29:33.152924 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:29:33.170459 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Getting quotas for project 981a261c09c74610a4f9f28330b20fe0. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:29:33.175134 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Getting quotas for user 6b29390a7b75432db2d0b069de8323da and project 981a261c09c74610a4f9f28330b20fe0. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:29:33.186284 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] [instance: 6800d9cb-1cc8-40df-97ac-8aa2659afa42] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:29:33.187196 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:29:33.187599 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:29:33.311046 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] [instance: 6800d9cb-1cc8-40df-97ac-8aa2659afa42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3342fa7-c228-4530-926d-2986c86ecdde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:29:33.312341 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:29:33.312745 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:29:33.650113 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:29:33.650521 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-b8291fed-6ae2-420f-8a89-fa30d2e32609 tempest-TestMinimumBasicScenario-488021559 tempest-TestMinimumBasicScenario-488021559-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:29:36.598988 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:29:37.616344 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46662. Aug 27 04:29:51.568834 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:30:24.075336 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:30:26.150864 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:30:27.166533 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46816. Aug 27 04:30:46.234962 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:30:47.255716 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46830. Aug 27 04:31:37.912581 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:31:38.929595 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46872. Aug 27 04:31:44.842618 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:31:46.216631 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:31:47.237480 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46878. Aug 27 04:32:19.308172 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:32:20.326106 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46950. Aug 27 04:32:37.616737 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:32:38.634363 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47090. Aug 27 04:32:47.651653 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Took 2.57 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:32:47.672090 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:47.672488 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:47.986471 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:47.986872 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:47.987591 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:47.987979 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.006306 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Getting quotas for project eba5e9abf01343edbf1a4692369f1a8a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:32:48.011617 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Getting quotas for user e1b5977e3f234e0eadffb131dab1ef80 and project eba5e9abf01343edbf1a4692369f1a8a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:32:48.024142 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: 496838cd-8e34-4694-8519-39fbb676d047] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:32:48.025133 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.025609 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.135765 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: 496838cd-8e34-4694-8519-39fbb676d047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:32:48.137114 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.137554 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.406100 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.406510 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.416788 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [9a39423f-7be0-4d12-9c7b-3fb61a280d67] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:32:49.433328 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [None req-6fcf31e1-c5db-4ae8-a2bc-095dd45f28ac tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [9a39423f-7be0-4d12-9c7b-3fb61a280d67] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47154. Aug 27 04:33:11.586024 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:34:31.457403 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [fa54404d-3f69-4115-b41d-a1ddfae51ae5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:34:32.474158 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [fa54404d-3f69-4115-b41d-a1ddfae51ae5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47326. Aug 27 04:34:34.858518 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Took 3.41 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:34:34.878105 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:34.878508 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:35.090119 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:35.090521 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:35.091274 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:35.091666 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:35.107249 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Getting quotas for project eba5e9abf01343edbf1a4692369f1a8a. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:34:35.111678 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Getting quotas for user e1b5977e3f234e0eadffb131dab1ef80 and project eba5e9abf01343edbf1a4692369f1a8a. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:34:35.122655 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: a42bb6d7-0c90-4baf-9ecf-38529ad61a47] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:34:35.123597 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:35.124000 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:35.245078 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: a42bb6d7-0c90-4baf-9ecf-38529ad61a47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:34:35.246372 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:35.246777 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:35.543142 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:35.543538 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:35.553090 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [bfee31d1-a63e-4713-9878-52e341b6835f] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:34:36.572989 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [None req-2df9c142-c3ef-4d95-8ed3-04e0c0c86c18 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [bfee31d1-a63e-4713-9878-52e341b6835f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47352. Aug 27 04:34:38.929939 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:34:39.957544 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47360. Aug 27 04:34:47.253016 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:34:48.275340 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47380. Aug 27 04:35:04.859223 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:35:24.093909 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:35:27.169985 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:35:28.186066 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47412. Aug 27 04:35:38.635021 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:35:39.650199 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47420. Aug 27 04:36:31.602878 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:36:47.236509 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:36:48.261925 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47476. Aug 27 04:37:19.690673 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:37:19.716870 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:19.717283 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:19.856024 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:19.856572 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:19.857423 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:19.857949 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:19.880328 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Getting quotas for project eba5e9abf01343edbf1a4692369f1a8a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:37:19.885969 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Getting quotas for user e1b5977e3f234e0eadffb131dab1ef80 and project eba5e9abf01343edbf1a4692369f1a8a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:37:19.900553 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: ce30878f-6fb3-4d70-92ab-29fc694707f7] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:37:19.901646 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:19.902120 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:19.979542 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: ce30878f-6fb3-4d70-92ab-29fc694707f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:37:19.981485 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:19.981980 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:20.252384 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:20.252932 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-6ce95f5a-7f09-4038-af98-c93b78fbb740 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:20.327920 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:37:21.347262 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47574. Aug 27 04:37:39.955838 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:37:40.972692 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47616. Aug 27 04:38:24.875987 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:38:36.385993 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method migrate_server {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 04:38:36.385993 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:36.385993 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:36.686101 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: ce30878f-6fb3-4d70-92ab-29fc694707f7] Restricting to cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) while migrating {{(pid=101511) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:212}} Aug 27 04:38:37.142792 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Created allocations for migration 55907234-0f1e-4641-8c52-bdeef80a84e0 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101511) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:88}} Aug 27 04:38:37.392515 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: ce30878f-6fb3-4d70-92ab-29fc694707f7] Calling prep_resize with selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [Selection(allocation_request='{"allocations": {"6e12de08-5d57-48b3-b442-9a192ba4e475": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["6e12de08-5d57-48b3-b442-9a192ba4e475"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=d68f2037-da7b-424a-bde4-8ae09fc2781e,compute_node_uuid=6e12de08-5d57-48b3-b442-9a192ba4e475,limits=SchedulerLimits,nodename='n-h1-802225-4',service_host='n-h1-802225-4')] {{(pid=101511) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:319}} Aug 27 04:38:37.634134 n-d-802225-4 nova-conductor[101511]: DEBUG nova.scheduler.client.report [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Overwriting current allocation {'allocations': {'8f1d7267-4d7c-4650-83e0-62766d0c0a07': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 213}}, 'project_id': 'eba5e9abf01343edbf1a4692369f1a8a', 'user_id': 'e1b5977e3f234e0eadffb131dab1ef80', 'consumer_generation': 1} on consumer ce30878f-6fb3-4d70-92ab-29fc694707f7 {{(pid=101511) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1959}} Aug 27 04:38:37.775328 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.tasks.migrate [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Created allocations for instance ce30878f-6fb3-4d70-92ab-29fc694707f7 on 6e12de08-5d57-48b3-b442-9a192ba4e475 {{(pid=101511) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:111}} Aug 27 04:38:37.806356 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.utils [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:38:37.807495 n-d-802225-4 nova-conductor[101511]: WARNING nova.scheduler.utils [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: ce30878f-6fb3-4d70-92ab-29fc694707f7] Setting instance to ACTIVE state. Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server [None req-c234cc21-e93e-4ff9-b4de-4abc519564c4 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Aug 27 04:38:38.204175 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server task.execute() Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.rollback(ex) Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server raise self.value Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return original(self) Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server return self._execute() Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 323, in _execute Aug 27 04:38:38.205399 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Aug 27 04:38:38.206790 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Aug 27 04:38:38.206790 n-d-802225-4 nova-conductor[101511]: ERROR oslo_messaging.rpc.server Aug 27 04:38:39.651977 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:38:40.668037 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47690. Aug 27 04:39:28.187779 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:39:29.203748 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47778. Aug 27 04:39:48.272191 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:39:49.294887 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47816. Aug 27 04:40:19.320368 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:40:24.112218 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:40:26.270613 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:40:40.973745 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:40:41.990020 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47934. Aug 27 04:40:48.256974 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:40:49.279569 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47950. Aug 27 04:41:21.347850 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:41:22.363661 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48016. Aug 27 04:41:40.668992 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:41:41.684706 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48052. Aug 27 04:41:44.892739 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:42:29.205038 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:42:30.221789 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48150. Aug 27 04:42:49.289968 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:42:50.310519 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48192. Aug 27 04:43:37.188223 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:43:39.337463 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:43:41.990822 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:43:43.008201 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48302. Aug 27 04:43:44.129523 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:43:46.286874 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:43:49.273982 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:43:50.296264 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48326. Aug 27 04:44:22.367011 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:44:23.389258 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48390. Aug 27 04:44:41.686493 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:44:42.704248 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48434. Aug 27 04:44:51.624753 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:44:57.500393 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:44:57.520038 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:57.523339 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:57.692327 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:57.692725 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:57.693662 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:57.694226 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:57.716018 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Getting quotas for project eba5e9abf01343edbf1a4692369f1a8a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:44:57.729062 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Getting quotas for user e1b5977e3f234e0eadffb131dab1ef80 and project eba5e9abf01343edbf1a4692369f1a8a. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:44:57.750018 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: 63bc9ec6-d0ac-4592-b0f0-3b6c9ca7c220] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:44:57.751596 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:57.752086 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:57.844595 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: 63bc9ec6-d0ac-4592-b0f0-3b6c9ca7c220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:44:57.848455 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:57.848455 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:58.195143 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:58.196304 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-83e7af64-5801-459c-91ba-acd4600e48e3 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:04.910076 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:46:43.009677 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:46:44.026850 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48636. Aug 27 04:46:50.292099 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:46:51.313878 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48640. Aug 27 04:46:57.204299 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:46:59.354301 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:47:23.389469 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:47:24.404673 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48666. Aug 27 04:47:30.226097 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:47:31.251106 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48670. Aug 27 04:47:42.704824 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:47:43.722084 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48706. Aug 27 04:47:50.310502 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:47:51.353603 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48742. Aug 27 04:47:56.550545 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:47:56.586593 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:56.587626 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:56.763423 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:56.763959 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:56.764758 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:56.765364 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:56.786098 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Getting quotas for project eba5e9abf01343edbf1a4692369f1a8a. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:47:56.792754 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Getting quotas for user e1b5977e3f234e0eadffb131dab1ef80 and project eba5e9abf01343edbf1a4692369f1a8a. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:47:56.808241 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: 053e09ee-9eda-496e-8118-de494813f803] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:47:56.809606 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:56.810209 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:56.903083 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] [instance: 053e09ee-9eda-496e-8118-de494813f803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:47:56.905724 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:56.906399 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:57.224101 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:57.224513 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-0979eeeb-89ff-4bcb-bb4c-eaa5906fb0e9 tempest-TestNetworkAdvancedServerOps-176423061 tempest-TestNetworkAdvancedServerOps-176423061-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:11.645228 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:48:24.926132 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:49:44.027570 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:49:45.057897 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48974. Aug 27 04:49:51.638139 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] [83ef34e2-dfe9-4263-821f-295a8d29f077] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:49:52.653413 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] [83ef34e2-dfe9-4263-821f-295a8d29f077] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49014. Aug 27 04:49:55.014676 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Took 3.38 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:49:55.036524 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:55.036931 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:55.280889 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:55.281203 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:55.281979 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:55.282367 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:55.300647 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Getting quotas for project 392fafbeaba04e7f81f445dd71fb7954. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:49:55.306572 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Getting quotas for user 1a155bd5cf4f474d91fc5e4df7434a46 and project 392fafbeaba04e7f81f445dd71fb7954. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:49:55.318894 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] [instance: 9a82e4f7-9134-46af-bd26-91cf83dd263e] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:49:55.319875 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:55.320283 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:55.391330 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] [instance: 9a82e4f7-9134-46af-bd26-91cf83dd263e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:49:55.392732 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:55.393147 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:55.637207 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:55.637691 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:55.648676 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] [9a39423f-7be0-4d12-9c7b-3fb61a280d67] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:49:56.666194 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [None req-a9f02d63-916c-4014-b6ed-07ee3632c5bb tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] [9a39423f-7be0-4d12-9c7b-3fb61a280d67] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49036. Aug 27 04:50:17.223042 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:50:19.371203 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:50:24.406800 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:50:25.423246 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49092. Aug 27 04:50:43.723719 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:50:44.740561 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49098. Aug 27 04:50:51.312204 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:50:52.332696 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49106. Aug 27 04:51:31.663090 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:51:44.943257 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:52:31.252643 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:52:32.268216 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49132. Aug 27 04:52:45.058651 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:52:46.074991 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49166. Aug 27 04:52:51.342123 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:52:52.363459 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49180. Aug 27 04:53:16.345555 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-45f74111-beda-4f30-b6df-572f0b68f8be tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method unshelve_instance {{(pid=101511) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 04:53:16.346055 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-45f74111-beda-4f30-b6df-572f0b68f8be tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:16.346492 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-45f74111-beda-4f30-b6df-572f0b68f8be tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:16.878926 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-45f74111-beda-4f30-b6df-572f0b68f8be tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] [instance: 9a82e4f7-9134-46af-bd26-91cf83dd263e] Requesting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) during scheduling {{(pid=101511) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:930}} Aug 27 04:53:17.180499 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-45f74111-beda-4f30-b6df-572f0b68f8be tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:53:17.187558 n-d-802225-4 nova-conductor[101511]: DEBUG nova.objects.instance [None req-45f74111-beda-4f30-b6df-572f0b68f8be tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lazy-loading 'flavor' on Instance uuid 9a82e4f7-9134-46af-bd26-91cf83dd263e {{(pid=101511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:53:44.742638 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:53:45.759324 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49416. Aug 27 04:54:51.679205 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:55:04.961013 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:55:17.242336 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:55:19.390091 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:55:24.154461 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:55:25.426800 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:55:26.312496 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:55:26.445512 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49508. Aug 27 04:55:32.270764 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:55:33.288806 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49604. Aug 27 04:55:46.075737 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:55:47.092812 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49658. Aug 27 04:55:51.563436 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:55:51.583807 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:55:51.584264 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:55:51.691088 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:55:51.691367 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:55:51.692757 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:55:51.693148 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:55:51.707797 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Getting quotas for project 392fafbeaba04e7f81f445dd71fb7954. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:55:51.712307 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Getting quotas for user 1a155bd5cf4f474d91fc5e4df7434a46 and project 392fafbeaba04e7f81f445dd71fb7954. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:55:51.722632 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] [instance: bf53fc79-168e-4bcb-bf7f-6ac99c32789d] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 04:55:51.723576 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:55:51.723978 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:55:51.774854 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] [instance: bf53fc79-168e-4bcb-bf7f-6ac99c32789d] block_device_mapping [BlockDeviceMapping(attachment_id=1617fdcf-26d9-4cc8-b65b-22f58d93f869,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a04a8a7-aa4b-4026-afe9-091fc887d1cd',volume_size=1,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 04:55:51.776203 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:55:51.776603 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:55:51.987871 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:55:51.988320 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-fcb71ec5-0b64-47a9-a2f9-33033a4ce71c tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:55:52.331810 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:55:53.356959 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49700. Aug 27 04:56:45.762025 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:56:46.778455 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49764. Aug 27 04:57:52.362467 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:57:53.383034 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49780. Aug 27 04:58:11.697009 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:58:24.980266 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:58:26.446934 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:58:27.464168 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49792. Aug 27 04:58:33.288938 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:58:34.305160 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49794. Aug 27 04:58:37.258654 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:58:39.407527 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:58:44.171406 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:58:46.333905 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:58:47.095083 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:58:48.110873 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49838. Aug 27 04:58:53.349924 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:58:54.370717 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49860. Aug 27 04:58:55.624232 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ad1a979b-66b1-448a-ada5-aba84fc10e1e tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Targeting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) for conductor method unshelve_instance {{(pid=101512) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Aug 27 04:58:55.624712 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad1a979b-66b1-448a-ada5-aba84fc10e1e tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:58:55.625164 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-ad1a979b-66b1-448a-ada5-aba84fc10e1e tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:58:55.857418 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ad1a979b-66b1-448a-ada5-aba84fc10e1e tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] [instance: bf53fc79-168e-4bcb-bf7f-6ac99c32789d] Requesting cell d68f2037-da7b-424a-bde4-8ae09fc2781e(cell1) during scheduling {{(pid=101512) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:930}} Aug 27 04:58:56.161567 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-ad1a979b-66b1-448a-ada5-aba84fc10e1e tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 04:58:56.169339 n-d-802225-4 nova-conductor[101512]: DEBUG nova.objects.instance [None req-ad1a979b-66b1-448a-ada5-aba84fc10e1e tempest-TestShelveInstance-2084161931 tempest-TestShelveInstance-2084161931-project] Lazy-loading 'flavor' on Instance uuid bf53fc79-168e-4bcb-bf7f-6ac99c32789d {{(pid=101512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:59:46.779942 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 04:59:47.796406 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49930. Aug 27 05:01:27.464780 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:01:28.480045 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50128. Aug 27 05:01:28.483537 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Took 1.34 seconds to select destinations for 1 instance(s). {{(pid=101511) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 05:01:28.505380 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:01:28.505729 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:01:28.705146 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:01:28.705844 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:01:28.706588 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:01:28.706985 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:01:28.722166 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Getting quotas for project dcba77e521514beca57504400bcef11f. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 05:01:28.727074 n-d-802225-4 nova-conductor[101511]: DEBUG nova.quota [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Getting quotas for user 2caf2e55227a4de79a47e8cbef483a8f and project dcba77e521514beca57504400bcef11f. Resources: {'cores', 'instances', 'ram'} {{(pid=101511) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 05:01:28.737924 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] [instance: 10bdbc77-9997-448e-a5a1-f1524c4007b3] Selected host: n-h1-802225-4; Selected node: n-h1-802225-4; Alternates: [('n-h2-802225-4', 'n-h2-802225-4')] {{(pid=101511) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 05:01:28.738846 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:01:28.739241 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:01:28.802543 n-d-802225-4 nova-conductor[101511]: DEBUG nova.conductor.manager [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] [instance: 10bdbc77-9997-448e-a5a1-f1524c4007b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e51448-2873-40f6-a19e-089e9ef9272f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101511) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 05:01:28.803722 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:01:28.804156 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:01:29.055234 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:01:29.055582 n-d-802225-4 nova-conductor[101511]: DEBUG oslo_concurrency.lockutils [None req-77c5c8c2-b080-426c-bed2-06d53fc0a1f8 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:01:31.713186 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:01:34.306725 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:01:35.322941 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50148. Aug 27 05:01:44.996584 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:01:48.112470 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:01:49.127365 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50176. Aug 27 05:01:53.381131 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:01:54.402816 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50182. Aug 27 05:02:04.188113 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:02:06.350971 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:02:47.796908 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:02:48.814409 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50210. Aug 27 05:03:37.276096 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:03:39.426027 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:03:54.368151 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:03:55.390805 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50234. Aug 27 05:04:28.482701 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:04:29.499330 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50410. Aug 27 05:04:30.597563 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=101512) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:912}} Aug 27 05:04:30.616327 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:04:30.616737 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:04:30.927308 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:04:30.927638 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:04:30.928349 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:04:30.928738 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:04:30.943936 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Getting quotas for project dcba77e521514beca57504400bcef11f. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 05:04:30.948661 n-d-802225-4 nova-conductor[101512]: DEBUG nova.quota [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Getting quotas for user 2caf2e55227a4de79a47e8cbef483a8f and project dcba77e521514beca57504400bcef11f. Resources: {'cores', 'instances', 'ram'} {{(pid=101512) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 05:04:30.959054 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] [instance: 254e8f42-90dc-485a-baa0-89a85ff0d33d] Selected host: n-h2-802225-4; Selected node: n-h2-802225-4; Alternates: [('n-h1-802225-4', 'n-h1-802225-4')] {{(pid=101512) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1656}} Aug 27 05:04:30.959980 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:04:30.960375 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:04:31.072375 n-d-802225-4 nova-conductor[101512]: DEBUG nova.conductor.manager [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] [instance: 254e8f42-90dc-485a-baa0-89a85ff0d33d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6eff6cc-6d5c-4079-9237-06ad005b9e7f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101512) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1400}} Aug 27 05:04:31.073649 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:04:31.074050 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:04:31.491108 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 05:04:31.491513 n-d-802225-4 nova-conductor[101512]: DEBUG oslo_concurrency.lockutils [None req-b9a18060-fda2-419d-99f3-e091ee1fb097 tempest-TestSnapshotPattern-2022567483 tempest-TestSnapshotPattern-2022567483-project] Lock "d68f2037-da7b-424a-bde4-8ae09fc2781e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 05:04:49.128787 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:04:50.144263 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50500. Aug 27 05:04:51.730063 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:05:05.012561 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:05:48.817320 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:05:49.833796 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50536. Aug 27 05:06:35.326781 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:06:36.344671 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50670. Aug 27 05:06:54.407096 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:06:55.385930 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:06:55.429770 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50824. Aug 27 05:06:56.408364 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50826. Aug 27 05:06:57.291064 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:06:59.442796 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:07:04.205576 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:07:06.368621 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:07:29.500832 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:07:30.516124 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50866. Aug 27 05:07:50.146503 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:07:51.162407 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50870. Aug 27 05:08:11.745689 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:08:25.028391 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:08:49.833708 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:08:50.849261 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50882. Aug 27 05:09:36.344837 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:09:37.360769 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50890. Aug 27 05:09:55.424948 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:09:56.405027 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:09:56.445258 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50896. Aug 27 05:09:57.424505 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50898. Aug 27 05:10:17.307480 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:10:19.459281 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:10:24.222265 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:10:26.384183 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:10:30.517827 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:10:31.534935 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50918. Aug 27 05:10:51.163733 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:10:52.181388 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50924. Aug 27 05:11:31.762640 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:11:45.044414 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:11:50.849832 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:11:51.866324 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50942. Aug 27 05:12:37.362722 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:12:38.378483 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [27c2e2e1-cecb-41fd-a35b-3ef6cccb678d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50952. Aug 27 05:12:56.442661 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:12:57.421868 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:12:57.463559 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b752ed-376b-4250-bbd4-db8627e4abe0] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50958. Aug 27 05:12:58.441854 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a7ce0c-73eb-4f8d-b8ca-b43ec8722300] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50960. Aug 27 05:13:31.534718 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:13:32.550689 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e1228a-e6e2-4ed2-95ab-7fed7a393937] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50962. Aug 27 05:13:37.323761 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:13:39.475522 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:13:44.238335 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:13:46.401192 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:13:52.180622 n-d-802225-4 nova-conductor[101512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:13:53.197387 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5ca72-113f-48fd-9528-ae0f33917a2d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50984. Aug 27 05:14:51.778585 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:14:51.866473 n-d-802225-4 nova-conductor[101511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 27 05:14:52.883463 n-d-802225-4 nova-conductor[101511]: INFO oslo.messaging._drivers.impl_rabbit [-] [043d3c37-2589-4a74-9c2c-43bb753c555a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50994. Aug 27 05:15:05.060623 n-d-802225-4 nova-conductor[101512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer