-- Logs begin at Fri 2021-05-28 01:41:33 UTC, end at Fri 2021-05-28 04:18:01 UTC. -- May 28 02:11:42.425223 n-d-764292-25 systemd[1]: Started Devstack devstack@n-super-cond.service. May 28 02:11:45.807096 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_db.sqlalchemy.engines [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 02:11:46.029259 n-d-764292-25 nova-conductor[97940]: DEBUG nova.context [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) {{(pid=97940) load_cells /opt/stack/nova/nova/context.py:464}} May 28 02:11:46.032794 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_concurrency.lockutils [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:11:46.034199 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_concurrency.lockutils [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:11:46.034927 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_concurrency.lockutils [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:11:46.036655 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_concurrency.lockutils [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:11:46.065353 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_db.sqlalchemy.engines [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 02:11:46.066185 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_db.sqlalchemy.engines [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 02:11:46.079148 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_concurrency.lockutils [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Acquired lock "singleton_lock" {{(pid=97940) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 28 02:11:46.079737 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_concurrency.lockutils [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Releasing lock "singleton_lock" {{(pid=97940) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 28 02:11:46.080584 n-d-764292-25 nova-conductor[97940]: INFO oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Starting 2 workers May 28 02:11:46.085267 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Started child 98809 {{(pid=97940) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 28 02:11:46.089606 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Started child 98810 {{(pid=97940) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 28 02:11:46.090825 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Full set of CONF: {{(pid=97940) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 28 02:11:46.091556 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ******************************************************************************** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 02:11:46.091951 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] Configuration options gathered from: {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 02:11:46.092408 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 02:11:46.092868 n-d-764292-25 nova-conductor[98809]: INFO nova.service [-] Starting conductor node (version 23.1.0) May 28 02:11:46.093353 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] config files: ['/etc/nova/nova.conf'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 02:11:46.093678 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ================================================================================ {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 02:11:46.094499 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] allow_resize_to_same_host = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.095014 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] arq_binding_timeout = 300 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.095521 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] block_device_allocate_retries = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.096087 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] block_device_allocate_retries_interval = 3 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.096640 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cert = self.pem {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.097130 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute_driver = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.098725 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute_monitors = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.099274 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] config_dir = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.105453 n-d-764292-25 nova-conductor[98810]: INFO nova.service [-] Starting conductor node (version 23.1.0) May 28 02:11:46.106544 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] config_drive_format = iso9660 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.106983 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] config_file = ['/etc/nova/nova.conf'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.107491 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] config_source = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.108017 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] console_host = n-d-764292-25 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.108509 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] control_exchange = nova {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.109008 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cpu_allocation_ratio = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.109458 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] daemon = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.110208 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] debug = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.110493 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] default_access_ip_network_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.111037 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] default_availability_zone = nova {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.111463 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] default_ephemeral_format = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.112188 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.116276 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] default_schedule_zone = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.116276 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] disk_allocation_ratio = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.116276 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] enable_new_services = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.116276 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] enabled_apis = ['osapi_compute'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.116276 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] enabled_ssl_apis = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.116276 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] flat_injected = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.119763 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] force_config_drive = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.121685 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] force_raw_images = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.122130 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] graceful_shutdown_timeout = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.123969 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] heal_instance_info_cache_interval = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.124799 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] host = n-d-764292-25 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.126592 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] initial_cpu_allocation_ratio = 16.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.127095 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] initial_disk_allocation_ratio = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.132690 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] initial_ram_allocation_ratio = 1.5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.132690 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.132915 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] instance_build_timeout = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.133307 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] instance_delete_interval = 300 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.133778 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] instance_format = [instance: %(uuid)s] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.134274 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] instance_name_template = instance-%08x {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.134734 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] instance_usage_audit = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.135017 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_db.sqlalchemy.engines [None req-d0280adf-c884-4862-b91b-c78b18c0bad3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 02:11:46.135317 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] instance_usage_audit_period = month {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.135843 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.137619 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] instances_path = /opt/stack/data/nova/instances {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.138361 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] internal_service_availability_zone = internal {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.138812 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] key = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.140671 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] live_migration_retry_count = 30 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.141739 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] log_config_append = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.142715 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.143860 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] log_dir = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.144332 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] log_file = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.144746 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] log_options = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.145222 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] log_rotate_interval = 1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.145711 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] log_rotate_interval_type = days {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.146205 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] log_rotation_type = none {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.146646 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.147032 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.148586 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.149083 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.149472 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.150484 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] long_rpc_timeout = 1800 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.151836 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] max_concurrent_builds = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.152747 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] max_concurrent_live_migrations = 1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.153221 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] max_concurrent_snapshots = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.157412 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] max_local_block_devices = 3 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.158535 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] max_logfile_count = 30 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.159004 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] max_logfile_size_mb = 200 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.160039 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] maximum_instance_delete_attempts = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.160939 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] metadata_listen = 0.0.0.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.162173 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] metadata_listen_port = 8775 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.162672 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] metadata_workers = 2 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.163133 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] migrate_max_retries = -1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.163635 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] mkisofs_cmd = genisoimage {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.164773 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_db.sqlalchemy.engines [None req-b22ba6d2-722b-4d5b-a07c-2035ac844a55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 02:11:46.165658 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] my_block_storage_ip = 10.222.0.24 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.167038 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] my_ip = 10.222.0.24 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.170782 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] network_allocate_retries = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.171538 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.172400 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] osapi_compute_listen = 0.0.0.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.173044 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] osapi_compute_listen_port = 8774 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.173611 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] osapi_compute_unique_server_name_scope = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.174531 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] osapi_compute_workers = 2 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.175095 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] password_length = 12 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.175837 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] periodic_enable = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.176524 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] periodic_fuzzy_delay = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.177111 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] pointer_model = usbtablet {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.177710 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] preallocate_images = none {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.178498 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] publish_errors = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.179299 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] pybasedir = /opt/stack/nova {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.180197 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ram_allocation_ratio = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.180764 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] rate_limit_burst = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.181351 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] rate_limit_except_level = CRITICAL {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.184960 n-d-764292-25 nova-conductor[98809]: DEBUG nova.service [None req-d0280adf-c884-4862-b91b-c78b18c0bad3 None None] Creating RPC server for service conductor {{(pid=98809) start /opt/stack/nova/nova/service.py:182}} May 28 02:11:46.193643 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] rate_limit_interval = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.194688 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] reboot_timeout = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.195500 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] reclaim_instance_interval = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.196980 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] record = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.197432 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] report_interval = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.197838 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] rescue_timeout = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.199189 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] reserved_host_cpus = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.199729 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] reserved_host_disk_mb = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.201162 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] reserved_host_memory_mb = 512 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.201473 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] reserved_huge_pages = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.201849 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] resize_confirm_window = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.202374 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] resize_fs_using_block_device = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.202676 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] resume_guests_state_on_host_boot = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.203076 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.204046 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] rpc_response_timeout = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.208030 n-d-764292-25 nova-conductor[98810]: DEBUG nova.service [None req-b22ba6d2-722b-4d5b-a07c-2035ac844a55 None None] Creating RPC server for service conductor {{(pid=98810) start /opt/stack/nova/nova/service.py:182}} May 28 02:11:46.208820 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] run_external_periodic_tasks = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.209551 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] running_deleted_instance_action = reap {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.209969 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] running_deleted_instance_poll_interval = 1800 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.215024 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] running_deleted_instance_timeout = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.215576 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler_instance_sync_interval = 120 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.215986 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_down_time = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.216660 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] servicegroup_driver = db {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.217055 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] shelved_offload_time = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.217442 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] shelved_poll_interval = 3600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.217861 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] shutdown_timeout = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.218265 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] source_is_ipv6 = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.218657 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ssl_only = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.219852 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] state_path = /opt/stack/data/nova {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.224769 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] sync_power_state_interval = 600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.225218 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] sync_power_state_pool_size = 1000 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.225729 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] syslog_log_facility = LOG_USER {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.226123 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] tempdir = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.226545 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] timeout_nbd = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.226961 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] transport_url = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.227355 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] update_resources_interval = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.227736 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] use_cow_images = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.228137 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] use_eventlog = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.228522 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] use_journal = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.228907 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] use_json = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.231236 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] use_rootwrap_daemon = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.231670 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] use_stderr = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.232073 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] use_syslog = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.232457 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vcpu_pin_set = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.232851 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vif_plugging_is_fatal = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.233244 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vif_plugging_timeout = 300 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.233663 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] virt_mkfs = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.234050 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] volume_usage_poll_interval = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.239336 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] watch_log_file = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.240941 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] web = /usr/share/spice-html5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 02:11:46.243207 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_concurrency.disable_process_locking = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.243207 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.244133 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.auth_strategy = keystone {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.245882 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.compute_link_prefix = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.246336 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.246761 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.dhcp_domain = novalocal {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.247167 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.enable_instance_password = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.248088 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.glance_link_prefix = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.248088 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.248373 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.248764 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.instance_list_per_project_cells = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.254297 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.list_records_by_skipping_down_cells = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.262050 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.local_metadata_per_cell = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.262650 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.max_limit = 1000 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.263081 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.metadata_cache_expiration = 15 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.266533 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.neutron_default_tenant_id = default {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.275647 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.use_forwarded_for = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.278426 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.use_neutron_default_nets = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.278879 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.281379 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.281929 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.282732 n-d-764292-25 nova-conductor[98809]: DEBUG nova.service [None req-d0280adf-c884-4862-b91b-c78b18c0bad3 None None] Join ServiceGroup membership for this service conductor {{(pid=98809) start /opt/stack/nova/nova/service.py:199}} May 28 02:11:46.283127 n-d-764292-25 nova-conductor[98809]: DEBUG nova.servicegroup.drivers.db [None req-d0280adf-c884-4862-b91b-c78b18c0bad3 None None] DB_Driver: join new ServiceGroup member n-d-764292-25 to the conductor group, service = {{(pid=98809) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 02:11:46.284185 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.vendordata_dynamic_ssl_certfile = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.284592 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.vendordata_dynamic_targets = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.284989 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.vendordata_jsonfile_path = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.285268 n-d-764292-25 nova-conductor[98810]: DEBUG nova.service [None req-b22ba6d2-722b-4d5b-a07c-2035ac844a55 None None] Join ServiceGroup membership for this service conductor {{(pid=98810) start /opt/stack/nova/nova/service.py:199}} May 28 02:11:46.285908 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api.vendordata_providers = ['StaticJSON'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.286150 n-d-764292-25 nova-conductor[98810]: DEBUG nova.servicegroup.drivers.db [None req-b22ba6d2-722b-4d5b-a07c-2035ac844a55 None None] DB_Driver: join new ServiceGroup member n-d-764292-25 to the conductor group, service = {{(pid=98810) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 28 02:11:46.286433 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.backend = dogpile.cache.memcached {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.286829 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.backend_argument = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.287230 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.config_prefix = cache.oslo {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.287637 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.debug_cache_backend = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.288027 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.enabled = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.288445 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.expiration_time = 600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.288941 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.memcache_dead_retry = 300 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.289325 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.289731 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.290131 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.memcache_pool_maxsize = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.290539 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.290966 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.291354 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.memcache_socket_timeout = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.291740 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.proxies = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.292121 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.tls_allowed_ciphers = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.292597 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.tls_cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.292973 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.tls_certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.293349 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.tls_enabled = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.293819 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cache.tls_keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.294377 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.auth_section = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.294792 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.auth_type = password {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.295165 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.295635 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.catalog_info = volumev3::publicURL {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.296039 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.296387 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.296763 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.cross_az_attach = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.297674 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.endpoint_template = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.298051 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.http_retries = 3 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.298466 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.298824 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.299224 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.os_region_name = RegionOne {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.299616 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.299988 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cinder.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.300374 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.300745 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute.cpu_dedicated_set = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.301124 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute.cpu_shared_set = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.301528 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute.image_type_exclude_list = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.301909 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.302303 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute.max_concurrent_disk_ops = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.302782 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute.max_disk_devices_to_attach = -1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.303183 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.303561 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute.resource_provider_association_refresh = 300 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.303935 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] compute.shutdown_retry_interval = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.304428 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] conductor.workers = 2 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.304850 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] console.allowed_origins = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.305226 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] console.ssl_ciphers = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.305618 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] console.ssl_minimum_version = default {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.306006 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] consoleauth.token_ttl = 600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.306436 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.306805 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.307202 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.307597 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.connect_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.307982 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.connect_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.308351 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.endpoint_override = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.308738 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.309095 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.309480 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.max_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.309842 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.min_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.310205 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.region_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.310759 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.service_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.311156 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.service_type = accelerator {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.311529 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.311896 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.status_code_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.312266 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.status_code_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.312685 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.313637 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.314014 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] cyborg.version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.314547 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.connection = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.314959 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.connection_debug = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.315348 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.connection_parameters = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.315733 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.connection_recycle_time = 3600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.316110 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.connection_trace = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.316482 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.max_overflow = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.316853 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.max_pool_size = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.317228 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.max_retries = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.317619 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.318001 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.pool_timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.318452 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.retry_interval = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.318823 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.slave_connection = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.319200 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] api_database.sqlite_synchronous = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.319581 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] devices.enabled_vgpu_types = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.319997 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.320369 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ephemeral_storage_encryption.enabled = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.320742 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.321147 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.api_servers = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.321529 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.321906 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.322302 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.322690 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.connect_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.323070 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.connect_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.323462 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.debug = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.323848 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.default_trusted_certificate_ids = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.324253 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.enable_certificate_validation = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.324637 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.enable_rbd_download = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.325007 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.endpoint_override = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.325412 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.325781 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.326147 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.max_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.326531 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.min_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.326910 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.num_retries = 3 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.327290 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.rbd_ceph_conf = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.327673 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.rbd_connect_timeout = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.328047 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.rbd_pool = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.328457 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.rbd_user = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.328831 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.region_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.329198 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.service_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.329586 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.service_type = image {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.329959 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.330362 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.status_code_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.330728 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.status_code_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.331096 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.331498 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.331869 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.verify_glance_signatures = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.332241 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] glance.version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.332634 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] guestfs.debug = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.333038 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.config_drive_cdrom = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.333408 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.config_drive_inject_password = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.333784 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.334154 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.enable_instance_metrics_collection = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.334557 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.enable_remotefx = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.334937 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.instances_path_share = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.335310 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.iscsi_initiator_list = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.335681 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.limit_cpu_features = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.336049 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.336418 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.336788 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.power_state_check_timeframe = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.337182 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.337562 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.337939 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.use_multipath_io = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.338337 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.volume_attach_retry_count = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.338714 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.339081 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.vswitch_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.339451 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.339832 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] mks.enabled = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.340813 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.341491 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] image_cache.manager_interval = 2400 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.341874 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] image_cache.precache_concurrency = 1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.342302 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] image_cache.remove_unused_base_images = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.342741 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.343071 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.343474 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] image_cache.subdirectory_name = _base {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.343890 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.api_max_retries = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.344295 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.api_retry_interval = 2 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.344689 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.auth_section = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.345063 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.auth_type = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.345431 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.345818 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.346167 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.346563 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.connect_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.346930 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.connect_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.347295 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.endpoint_override = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.347670 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.348037 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.348403 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.max_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.348766 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.min_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.349133 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.partition_key = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.349508 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.peer_list = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.349877 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.region_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.350263 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.serial_console_state_timeout = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.350631 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.service_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.351033 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.service_type = baremetal {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.351402 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.351769 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.status_code_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.352132 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.status_code_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.352496 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.352899 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.353269 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ironic.version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.353682 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.354109 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] key_manager.fixed_key = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.354590 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.354963 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.barbican_api_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.355336 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.barbican_endpoint = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.355752 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.barbican_endpoint_type = public {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.356117 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.barbican_region_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.356481 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.356844 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.357215 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.357609 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.357972 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.358390 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.number_of_retries = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.358782 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.retry_delay = 1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.359168 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.360042 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.360410 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.verify_ssl = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.360774 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] barbican.verify_ssl_path = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.361179 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.approle_role_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.361545 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.approle_secret_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.361909 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.362301 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.362694 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.363078 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.363445 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.363830 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.kv_mountpoint = secret {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.364205 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.kv_version = 2 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.364573 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.root_token_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.364947 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.365317 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.ssl_ca_crt_file = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.365685 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.366153 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.use_ssl = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.366485 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.367222 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.367386 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.367628 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.367996 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.connect_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.368369 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.connect_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.368736 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.endpoint_override = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.369114 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.369481 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.369845 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.max_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.370215 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.min_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.370606 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.region_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.370973 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.service_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.371375 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.service_type = identity {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.371751 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.372118 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.status_code_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.372490 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.status_code_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.372878 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.373301 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.373725 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] keystone.version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.374132 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.connection_uri = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.374551 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.cpu_mode = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.374957 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.cpu_model_extra_flags = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.375991 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.cpu_models = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.376390 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.device_detach_attempts = 8 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.376767 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.device_detach_timeout = 20 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.377177 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.disk_cachemodes = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.377510 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.disk_prefix = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.377887 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.enabled_perf_events = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.378276 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.file_backed_memory = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.378657 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.gid_maps = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.379040 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.hw_disk_discard = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.379423 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.hw_machine_type = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.379788 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.images_rbd_ceph_conf = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.380162 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.380560 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.380941 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.images_rbd_glance_store_name = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.381324 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.images_rbd_pool = rbd {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.381730 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.images_type = default {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.382096 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.images_volume_group = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.382512 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.inject_key = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.382887 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.inject_partition = -2 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.383284 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.inject_password = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.383675 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.iscsi_iface = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.384064 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.iser_use_multipath = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.384434 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_bandwidth = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.384807 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.385192 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_downtime = 500 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.385608 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.385935 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.386342 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_inbound_addr = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.386703 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.387094 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_permit_post_copy = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.387464 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_scheme = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.387853 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_timeout_action = abort {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.388230 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_tunnelled = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.388600 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_uri = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.388974 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.live_migration_with_native_tls = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.389365 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.max_queues = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.389842 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.390216 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.nfs_mount_options = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.390763 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.391162 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.391536 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.num_iser_scan_tries = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.391904 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.num_memory_encrypted_guests = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.392275 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.392649 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.num_pcie_ports = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.393046 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.num_volume_scan_tries = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.393427 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.pmem_namespaces = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.393795 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.quobyte_client_cfg = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.394289 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.394668 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.rbd_connect_timeout = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.395064 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.395441 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.395804 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.rbd_secret_uuid = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.396170 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.rbd_user = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.396549 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.396942 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.remote_filesystem_transport = ssh {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.397310 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.rescue_image_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.397696 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.rescue_kernel_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.398062 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.rescue_ramdisk_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.398469 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.rng_dev_path = /dev/urandom {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.398847 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.rx_queue_size = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.399230 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.smbfs_mount_options = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.399707 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.400081 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.snapshot_compression = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.400449 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.snapshot_image_format = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.400915 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.401291 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.sparse_logical_volumes = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.401662 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.swtpm_enabled = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.402053 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.swtpm_group = tss {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.402462 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.swtpm_user = tss {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.402850 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.sysinfo_serial = unique {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.403224 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.tx_queue_size = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.403607 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.uid_maps = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.403983 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.use_virtio_for_bridges = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.404369 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.virt_type = kvm {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.404753 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.volume_clear = zero {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.405126 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.volume_clear_size = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.405507 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.volume_use_multipath = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.405872 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.vzstorage_cache_path = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.406300 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.406719 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.vzstorage_mount_group = qemu {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.407103 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.vzstorage_mount_opts = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.407582 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.407984 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.408378 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.vzstorage_mount_user = stack {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.408754 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.409158 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.auth_section = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.409541 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.auth_type = password {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.409908 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.410295 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.410717 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.411061 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.connect_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.411438 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.connect_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.411822 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.default_floating_pool = public {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.412214 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.endpoint_override = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.412588 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.extension_sync_interval = 600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.412964 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.http_retries = 3 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.413336 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.413706 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.414072 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.max_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.414479 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.414847 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.min_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.415230 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.ovs_bridge = br-int {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.415609 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.physnets = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.415991 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.region_name = RegionOne {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.416373 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.service_metadata_proxy = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.416742 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.service_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.417214 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.service_type = network {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.417522 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.417894 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.status_code_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.418285 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.status_code_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.418654 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.419056 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.419423 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] neutron.version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.419806 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] notifications.bdms_in_notifications = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.420219 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] notifications.default_level = INFO {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.420604 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] notifications.notification_format = unversioned {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.420975 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] notifications.notify_on_state_change = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.421364 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.421750 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] pci.alias = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.422680 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] pci.passthrough_whitelist = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.423091 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.auth_section = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.423480 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.auth_type = password {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.423887 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.auth_url = http://10.222.0.24/identity {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.424252 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.424619 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.424987 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.425350 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.connect_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.425716 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.connect_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.426099 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.default_domain_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.426490 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.default_domain_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.426857 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.domain_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.427221 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.domain_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.427647 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.endpoint_override = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.427938 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.428298 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.429143 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.max_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.429513 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.min_version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.429894 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.password = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.430281 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.project_domain_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.430670 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.project_domain_name = Default {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.431061 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.project_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.431445 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.project_name = service {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.431827 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.region_name = RegionOne {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.432195 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.service_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.432575 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.service_type = placement {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.432946 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.433313 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.status_code_retries = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.433684 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.status_code_retry_delay = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.434061 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.system_scope = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.434444 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.434819 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.trust_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.435210 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.user_domain_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.435590 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.user_domain_name = Default {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.435982 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.user_id = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.436369 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.username = placement {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.436793 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.437159 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] placement.version = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.437586 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] powervm.disk_driver = localdisk {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.438553 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] powervm.proc_units_factor = 0.1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.438940 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] powervm.volume_group_name = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.439329 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.cores = 20 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.439701 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.count_usage_from_placement = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.440083 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.440479 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.injected_file_content_bytes = 10240 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.440857 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.injected_file_path_length = 255 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.441233 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.injected_files = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.441608 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.instances = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.441985 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.key_pairs = 100 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.442381 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.metadata_items = 128 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.442754 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.ram = 51200 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.443131 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.recheck_quota = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.443496 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.server_group_members = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.443868 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] quota.server_groups = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.444249 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] rdp.enabled = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.444894 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.445329 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.445711 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.446088 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.image_metadata_prefilter = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.446483 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.446872 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.max_attempts = 3 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.447269 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.max_placement_results = 1000 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.447701 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.448015 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.query_placement_for_availability_zone = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.448392 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.query_placement_for_image_type_support = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.448782 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.449163 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] scheduler.workers = 2 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.449593 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.449983 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.450433 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.450832 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.451210 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.451585 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.451965 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.452409 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.452802 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.host_subset_size = 1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.453178 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.453584 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.453971 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.isolated_hosts = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.454383 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.isolated_images = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.454849 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.455151 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.455525 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.455906 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.456291 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.456658 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.457032 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.457406 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.457928 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.track_instance_changes = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.458348 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.458746 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] metrics.required = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.459121 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] metrics.weight_multiplier = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.459539 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] metrics.weight_of_unavailable = -10000.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.459887 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] metrics.weight_setting = [] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.460444 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.460821 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] serial_console.enabled = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.461234 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] serial_console.port_range = 10000:20000 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.461620 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.462001 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.462435 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] serial_console.serialproxy_port = 6083 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.462823 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_user.auth_section = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.463231 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_user.auth_type = password {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.463613 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_user.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.463980 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_user.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.464361 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_user.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.464729 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_user.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.465109 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_user.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.465486 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_user.send_service_user_token = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.465855 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_user.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.466504 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] service_user.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.466902 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] spice.agent_enabled = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.467273 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] spice.enabled = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.467857 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.468288 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] spice.html5proxy_host = 0.0.0.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.468670 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] spice.html5proxy_port = 6082 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.469085 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] spice.server_listen = 127.0.0.1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.469474 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.469884 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] upgrade_levels.baseapi = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.470285 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] upgrade_levels.cert = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.470677 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] upgrade_levels.compute = auto {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.471046 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] upgrade_levels.conductor = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.471416 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] upgrade_levels.scheduler = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.471795 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vendordata_dynamic_auth.auth_section = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.472186 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vendordata_dynamic_auth.auth_type = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.472557 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vendordata_dynamic_auth.cafile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.472922 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vendordata_dynamic_auth.certfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.473304 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.473675 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vendordata_dynamic_auth.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.474045 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vendordata_dynamic_auth.keyfile = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.474442 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.474805 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vendordata_dynamic_auth.timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.475224 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.api_retry_count = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.475588 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.ca_file = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.475981 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.cache_prefix = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.476352 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.cluster_name = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.476724 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.connection_pool_size = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.477088 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.console_delay_seconds = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.477453 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.datastore_regex = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.477834 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.host_ip = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.478312 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.host_password = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.478599 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.host_port = 443 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.478972 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.host_username = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.479343 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.insecure = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.479707 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.integration_bridge = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.480080 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.maximum_objects = 100 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.480449 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.pbm_default_policy = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.484318 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.pbm_enabled = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.484318 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.pbm_wsdl_location = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.484318 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.484318 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.serial_port_proxy_uri = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.484318 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.serial_port_service_uri = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.484318 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.task_poll_interval = 0.5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.484318 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.use_linked_clone = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.486132 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.vnc_keymap = en-us {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.486132 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.vnc_port = 5900 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.486132 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vmware.vnc_port_total = 10000 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.486132 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vnc.auth_schemes = ['none'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.486132 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vnc.enabled = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.486132 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.487099 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.487099 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vnc.novncproxy_port = 6080 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.487391 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vnc.server_listen = 127.0.0.1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.487614 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.487983 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vnc.vencrypt_ca_certs = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.488365 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vnc.vencrypt_client_cert = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.488722 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] vnc.vencrypt_client_key = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.489139 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.489512 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.disable_group_policy_check_upcall = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.489884 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.490276 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.disable_native_luksv1 = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.490725 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.disable_rootwrap = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.491132 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.enable_numa_live_migration = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.491512 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.491888 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.492260 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.492632 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.rbd_volume_local_attach = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.493005 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.493478 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.493867 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.client_socket_timeout = 900 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.494325 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.default_pool_size = 1000 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.494658 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.keep_alive = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.495035 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.max_header_line = 16384 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.495451 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.secure_proxy_ssl_header = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.495769 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.ssl_ca_file = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.496152 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.ssl_cert_file = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.496522 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.ssl_key_file = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.496901 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.tcp_keepidle = 600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.497294 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.497830 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] zvm.ca_file = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.498026 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] zvm.cloud_connector_url = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.498547 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.498919 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] zvm.reachable_timeout = 300 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.499366 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_policy.enforce_new_defaults = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.499740 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_policy.enforce_scope = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.500147 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_policy.policy_default_rule = default {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.501184 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.501585 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_policy.policy_file = policy.yaml {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.502015 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.502418 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.502791 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.503161 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.503536 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.503942 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.504443 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] profiler.connection_string = messaging:// {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.504773 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] profiler.enabled = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.505176 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] profiler.es_doc_type = notification {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.505578 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] profiler.es_scroll_size = 10000 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.505959 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] profiler.es_scroll_time = 2m {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.506355 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] profiler.filter_error_trace = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.506745 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] profiler.hmac_keys = SECRET_KEY {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.507130 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] profiler.sentinel_service_name = mymaster {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.507513 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] profiler.socket_timeout = 0.1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.507885 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] profiler.trace_sqlalchemy = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.508298 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.backend = sqlalchemy {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.508691 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.connection = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.509070 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.connection_debug = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.509458 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.connection_parameters = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.509846 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.connection_recycle_time = 3600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.510222 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.connection_trace = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.510615 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.db_inc_retry_interval = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.510994 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.db_max_retries = 20 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.511365 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.db_max_retry_interval = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.511740 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.db_retry_interval = 1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.512120 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.max_overflow = 50 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.512496 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.max_pool_size = 5 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.512877 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.max_retries = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.513249 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.mysql_enable_ndb = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.513634 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.514011 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.pool_timeout = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.514418 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.retry_interval = 10 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.514820 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.slave_connection = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.515160 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.sqlite_synchronous = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.515534 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.use_db_reconnect = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.515940 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] database.use_tpool = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.516349 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] remote_debug.host = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.516740 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] remote_debug.port = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.517150 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.517527 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.517909 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.518306 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.518693 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.519070 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.519456 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.519844 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.520230 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.520603 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.520997 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.521380 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.521771 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.522145 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.522542 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.522935 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.523312 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.523689 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.524061 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.524437 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.524816 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.525206 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.ssl = False {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.525600 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.525996 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.526408 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.526799 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_rabbit.ssl_version = {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.527253 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.527625 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_notifications.retry = -1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.528048 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.528439 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_messaging_notifications.transport_url = **** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.528855 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_reports.file_event_handler = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.529261 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.529642 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] oslo_reports.log_dir = None {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 02:11:46.529946 n-d-764292-25 nova-conductor[97940]: DEBUG oslo_service.service [None req-925236ff-0a44-4d0d-bff6-58e20e4b3a1a None None] ******************************************************************************** {{(pid=97940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 02:14:46.257263 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:14:46.260303 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:14:47.278862 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 53998. May 28 02:14:47.291478 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 54000. May 28 02:17:47.276394 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:17:47.288855 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:17:48.299075 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 54064. May 28 02:17:48.309735 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 54066. May 28 02:20:46.161102 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_db.sqlalchemy.engines [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Parent process 97940 forked (98810) with an open database connection, which is being discarded and recreated. {{(pid=98810) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} May 28 02:20:47.416002 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Took 1.24 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:20:47.454354 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:47.457501 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:47.477094 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_db.sqlalchemy.engines [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 02:20:47.590827 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:47.592895 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:47.594174 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:47.594784 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:47.627590 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_db.sqlalchemy.engines [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 02:20:47.649346 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Getting quotas for project dcefaa369831409aa2b53369aa7f949d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:20:47.656137 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Getting quotas for user 41e74f458b99447393a51268416081d5 and project dcefaa369831409aa2b53369aa7f949d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:20:47.668858 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] [instance: f63e2384-b7f3-4810-97af-358cca863615] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:20:47.670173 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:47.671000 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:47.684808 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] [instance: f63e2384-b7f3-4810-97af-358cca863615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:20:47.687767 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:47.688153 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:47.751227 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:47.751750 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:47.752480 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-403c6f2b-8375-4b09-86be-8bd2d0c03110 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Acquired lock "compute-rpcapi-router" {{(pid=98810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 28 02:20:47.753831 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-142465de-6218-4a99-b833-59930016f9ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:47.754430 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-142465de-6218-4a99-b833-59930016f9ef None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:47.755355 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-142465de-6218-4a99-b833-59930016f9ef None None] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:47.755847 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-142465de-6218-4a99-b833-59930016f9ef None None] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:47.767415 n-d-764292-25 nova-conductor[98810]: INFO nova.compute.rpcapi [None req-142465de-6218-4a99-b833-59930016f9ef None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 28 02:20:47.768367 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-142465de-6218-4a99-b833-59930016f9ef None None] Releasing lock "compute-rpcapi-router" {{(pid=98810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 28 02:20:48.305941 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:20:49.348173 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 54878. May 28 02:20:49.499835 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:20:49.533006 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:49.533787 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:49.624436 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:49.625026 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:49.626044 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:49.626635 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:49.648093 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Getting quotas for project 1869c4ce1c394f1b9d7d7c15f2791f60. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:20:49.652770 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Getting quotas for user 53a0f878083c417f9d69f940c02f2ba8 and project 1869c4ce1c394f1b9d7d7c15f2791f60. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:20:49.669298 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] [instance: 17173b2d-74a4-4900-8d2d-dab992e718ce] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:20:49.670170 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:49.675221 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:49.707288 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] [instance: 17173b2d-74a4-4900-8d2d-dab992e718ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:20:49.708889 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:49.709700 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:20:49.781004 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:20:49.781415 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f52c0457-0d86-47ee-86ae-0d50eeca54b6 tempest-AggregatesAdminTestJSON-677549811 tempest-AggregatesAdminTestJSON-677549811-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:09.648748 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:21:09.673111 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:09.673519 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:09.731553 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:09.732115 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:09.733048 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:09.733587 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:09.750612 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Getting quotas for project 9b09a5f426824ba2a6106a6722143a68. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:21:09.754513 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Getting quotas for user 7e923f4c6af04789a57e119362022a37 and project 9b09a5f426824ba2a6106a6722143a68. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:21:09.766304 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] [instance: 088a33d1-3cb2-48ac-afa2-8d26b793533e] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:21:09.767379 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:09.767793 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:09.774844 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] [instance: 088a33d1-3cb2-48ac-afa2-8d26b793533e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:21:09.776204 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:09.776606 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:09.824636 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:09.825513 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-5673eeae-1648-40ee-8005-433cb604c883 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:23.500113 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_db.sqlalchemy.engines [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Parent process 97940 forked (98809) with an open database connection, which is being discarded and recreated. {{(pid=98809) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} May 28 02:21:23.965188 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:21:24.018999 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:24.023259 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:24.045341 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_db.sqlalchemy.engines [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 02:21:24.202337 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:24.204049 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:24.204950 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:24.205496 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:24.236348 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_db.sqlalchemy.engines [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 02:21:24.266893 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Getting quotas for project 2e57a2a54bec44c489f7d6d8293cae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:21:24.272334 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Getting quotas for user e0e14e4815c14bf3a820f28fedf0d2f6 and project 2e57a2a54bec44c489f7d6d8293cae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:21:24.292555 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: 28288f9c-26d0-4e69-a057-3e3d17cf61b5] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:21:24.293950 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:24.294716 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:24.308402 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: 28288f9c-26d0-4e69-a057-3e3d17cf61b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:21:24.311381 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:24.311797 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:24.395352 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:24.401740 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:24.402415 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-17cdf7f0-59e3-4217-b22b-883db29fcd2e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Acquired lock "compute-rpcapi-router" {{(pid=98809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 28 02:21:24.406163 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-aa3e4716-bbe4-4f36-974d-90a2951700a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:24.410364 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-aa3e4716-bbe4-4f36-974d-90a2951700a3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:24.411420 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-aa3e4716-bbe4-4f36-974d-90a2951700a3 None None] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:24.412252 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-aa3e4716-bbe4-4f36-974d-90a2951700a3 None None] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:24.429603 n-d-764292-25 nova-conductor[98809]: INFO nova.compute.rpcapi [None req-aa3e4716-bbe4-4f36-974d-90a2951700a3 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 28 02:21:24.431974 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-aa3e4716-bbe4-4f36-974d-90a2951700a3 None None] Releasing lock "compute-rpcapi-router" {{(pid=98809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 28 02:21:28.874727 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-715b8991-6a10-4ca7-be60-8b82c5d41905 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:21:28.875317 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-715b8991-6a10-4ca7-be60-8b82c5d41905 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:28.876398 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-715b8991-6a10-4ca7-be60-8b82c5d41905 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:29.374030 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-715b8991-6a10-4ca7-be60-8b82c5d41905 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Created allocations for migration 91fa2fdc-28eb-4545-a077-acab9acd5375 on 396f34e1-470a-4135-acc4-c392f4cd57ff {{(pid=98810) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:21:29.589454 n-d-764292-25 nova-conductor[98810]: DEBUG nova.scheduler.utils [None req-715b8991-6a10-4ca7-be60-8b82c5d41905 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] [instance: 088a33d1-3cb2-48ac-afa2-8d26b793533e] Instance allocations successfully created on destination node 1bff8e46-e9c8-450f-8078-657cbe80b915: {'allocations': {'1bff8e46-e9c8-450f-8078-657cbe80b915': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98810) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 02:21:29.589919 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-715b8991-6a10-4ca7-be60-8b82c5d41905 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lazy-loading 'resources' on Instance uuid 088a33d1-3cb2-48ac-afa2-8d26b793533e {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:21:29.596292 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-715b8991-6a10-4ca7-be60-8b82c5d41905 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lazy-loading 'pci_requests' on Instance uuid 088a33d1-3cb2-48ac-afa2-8d26b793533e {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:21:30.084316 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.live_migrate [None req-715b8991-6a10-4ca7-be60-8b82c5d41905 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] [instance: 088a33d1-3cb2-48ac-afa2-8d26b793533e] Start binding ports on destination host: n-h2-764292-25 {{(pid=98810) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 02:21:30.527968 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:21:30.574851 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:30.575937 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:30.659075 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:30.659870 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:30.661499 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:30.662121 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:30.689822 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Getting quotas for project 480125ab262d4a97a5af0f69f2b8cdf1. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:21:30.697115 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Getting quotas for user 08f224d14f714eaf8379550ab14cb0d7 and project 480125ab262d4a97a5af0f69f2b8cdf1. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:21:30.719674 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] [instance: 358ba03a-77e7-4cca-b9e6-ae034b1dfe45] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:21:30.721114 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:30.721726 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:30.736258 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] [instance: 358ba03a-77e7-4cca-b9e6-ae034b1dfe45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:21:30.739061 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:30.740687 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:30.790085 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:30.791796 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a0541be2-9c2d-4704-a49b-ebaebdb77395 tempest-ServerDiagnosticsNegativeTest-1642605372 tempest-ServerDiagnosticsNegativeTest-1642605372-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:35.384742 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:21:35.448794 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:35.449265 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:35.550268 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:35.550710 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:35.553585 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:35.555529 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:35.627453 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Getting quotas for project dcefaa369831409aa2b53369aa7f949d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:21:35.644144 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Getting quotas for user 41e74f458b99447393a51268416081d5 and project dcefaa369831409aa2b53369aa7f949d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:21:35.694658 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] [instance: 158e4eb3-1668-49f0-b321-eabacd7b55f1] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:21:35.702162 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:35.702674 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:35.723454 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] [instance: 158e4eb3-1668-49f0-b321-eabacd7b55f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:21:35.728203 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:35.728626 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:35.812386 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:35.812856 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b31310b5-8a5b-46ea-b4ee-62d56df8f663 tempest-DeleteServersAdminTestJSON-1227744375 tempest-DeleteServersAdminTestJSON-1227744375-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:38.429060 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:21:38.476566 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:38.479075 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:38.581602 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:38.582793 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:38.585183 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:38.586467 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:38.610483 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Getting quotas for project 42e0b0528239405eb3ed832b9e49200e. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:21:38.616080 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Getting quotas for user 552cf738508942f7a90dd152101a6fec and project 42e0b0528239405eb3ed832b9e49200e. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:21:38.628487 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] [instance: 0d46f5eb-e8db-400e-9aba-0667b1145d1c] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:21:38.629972 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:38.631314 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:38.639628 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] [instance: 0d46f5eb-e8db-400e-9aba-0667b1145d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:21:38.642283 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:38.642922 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:38.696809 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:38.698029 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-81f56219-e26e-4574-aca0-bd5b69e06db4 tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:40.275848 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:21:40.299252 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:40.299852 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:40.406077 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:40.406515 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:40.407446 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:40.412866 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:40.459617 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Getting quotas for project 42e0b0528239405eb3ed832b9e49200e. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:21:40.464652 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Getting quotas for user 552cf738508942f7a90dd152101a6fec and project 42e0b0528239405eb3ed832b9e49200e. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:21:40.486728 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] [instance: 38ede696-df6d-4d23-9713-0362bd4158eb] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:21:40.487757 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:40.488189 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:40.501515 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] [instance: 38ede696-df6d-4d23-9713-0362bd4158eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:21:40.503947 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:40.506733 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:40.567024 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:40.567729 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7f4bedc9-4856-4a8c-b101-37aa0e4e113a tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:49.449662 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-80b55c68-f97c-4d26-b56e-078bb041b0f6 tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:21:49.450189 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-80b55c68-f97c-4d26-b56e-078bb041b0f6 tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:49.450549 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-80b55c68-f97c-4d26-b56e-078bb041b0f6 tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:50.099752 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-80b55c68-f97c-4d26-b56e-078bb041b0f6 tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] [instance: 28288f9c-26d0-4e69-a057-3e3d17cf61b5] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98809) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 02:21:50.931444 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-80b55c68-f97c-4d26-b56e-078bb041b0f6 tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] Created allocations for migration 7a9ea0ba-fdb5-4666-91e3-5ffa703bb35c on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:21:51.290592 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-80b55c68-f97c-4d26-b56e-078bb041b0f6 tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] [instance: 28288f9c-26d0-4e69-a057-3e3d17cf61b5] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98809) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 02:21:53.519279 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:21:53.566533 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:53.566925 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:53.645520 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:53.646815 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:53.647575 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:53.647976 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:53.667474 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Getting quotas for project 9b09a5f426824ba2a6106a6722143a68. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:21:53.671743 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Getting quotas for user 7e923f4c6af04789a57e119362022a37 and project 9b09a5f426824ba2a6106a6722143a68. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:21:53.685590 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] [instance: 9de68f68-f16e-4071-99f2-4b730759063a] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:21:53.686959 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:53.687517 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:53.698438 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] [instance: 9de68f68-f16e-4071-99f2-4b730759063a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:21:53.701339 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:53.702293 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:53.753644 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:53.755546 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bbd1d72-8b7e-4a23-a1fd-037368dcf317 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:58.900119 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:21:58.927520 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:58.927864 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:59.006625 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:59.010308 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:59.011549 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:59.011959 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:59.053189 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Getting quotas for project a88ad6bd89294dfdbb46f1c403e107c2. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:21:59.057703 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Getting quotas for user b7dc3007a8bb47d48c48f1fe06d4364f and project a88ad6bd89294dfdbb46f1c403e107c2. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:21:59.067446 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] [instance: 74ff5896-5e9b-415b-b7ea-a183b2f28515] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:21:59.068886 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:59.069299 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:59.075779 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] [instance: 74ff5896-5e9b-415b-b7ea-a183b2f28515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:21:59.076940 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:59.077332 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:21:59.105676 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:21:59.106126 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e8318888-2a53-401c-ab4e-de5c56e39688 tempest-TenantUsagesTestJSON-369669845 tempest-TenantUsagesTestJSON-369669845-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:06.207424 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:22:06.240055 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:06.253903 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:06.357127 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:06.357524 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:06.358257 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:06.358643 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:06.387992 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Getting quotas for project 42e0b0528239405eb3ed832b9e49200e. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:22:06.393449 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Getting quotas for user 552cf738508942f7a90dd152101a6fec and project 42e0b0528239405eb3ed832b9e49200e. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:22:06.405964 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] [instance: 8963c407-44d8-4908-9c8f-2496903f8472] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:22:06.407328 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:06.408056 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:06.417541 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] [instance: 8963c407-44d8-4908-9c8f-2496903f8472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:22:06.419304 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:06.420184 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:06.488256 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:06.488666 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cc3d798e-2ecf-49ed-a09e-6ac4cda1b40c tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:14.084524 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-628393a2-7c71-4774-8241-6bc5ca0b0927 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:22:14.085773 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-628393a2-7c71-4774-8241-6bc5ca0b0927 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:14.086823 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-628393a2-7c71-4774-8241-6bc5ca0b0927 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:14.501667 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-628393a2-7c71-4774-8241-6bc5ca0b0927 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Created allocations for migration 50678a9a-48e6-4c84-b5e5-4fa3bf43cc9a on 396f34e1-470a-4135-acc4-c392f4cd57ff {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:22:14.611858 n-d-764292-25 nova-conductor[98809]: DEBUG nova.scheduler.utils [None req-628393a2-7c71-4774-8241-6bc5ca0b0927 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] [instance: 9de68f68-f16e-4071-99f2-4b730759063a] Instance allocations successfully created on destination node 1bff8e46-e9c8-450f-8078-657cbe80b915: {'allocations': {'1bff8e46-e9c8-450f-8078-657cbe80b915': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98809) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 02:22:14.612387 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance [None req-628393a2-7c71-4774-8241-6bc5ca0b0927 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lazy-loading 'resources' on Instance uuid 9de68f68-f16e-4071-99f2-4b730759063a {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:22:14.619371 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance [None req-628393a2-7c71-4774-8241-6bc5ca0b0927 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lazy-loading 'pci_requests' on Instance uuid 9de68f68-f16e-4071-99f2-4b730759063a {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:22:15.119404 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.live_migrate [None req-628393a2-7c71-4774-8241-6bc5ca0b0927 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] [instance: 9de68f68-f16e-4071-99f2-4b730759063a] Start binding ports on destination host: n-h2-764292-25 {{(pid=98809) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 02:22:15.385205 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:22:15.410346 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:15.410760 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:15.478176 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:15.478617 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:15.479331 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:15.479722 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:15.497133 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Getting quotas for project f1d33dd44f5d4a24bcd7e92b086f54fa. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:22:15.500911 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Getting quotas for user 817c9243b45e451ca8a89467caff0019 and project f1d33dd44f5d4a24bcd7e92b086f54fa. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:22:15.526839 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] [instance: e6ae2f0d-737d-40da-9c01-e455f3be175c] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:22:15.527947 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:15.528660 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:15.541649 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] [instance: e6ae2f0d-737d-40da-9c01-e455f3be175c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:22:15.543752 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:15.544303 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:15.589592 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:15.590198 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d8b19eef-173d-43c9-af2e-0712c356c93a tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:33.916718 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:22:33.972195 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:33.972595 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:34.072534 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:34.073294 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:34.074033 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:34.074450 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:34.105048 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Getting quotas for project 58c4a340e93a4ec1993007691903a970. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:22:34.117159 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Getting quotas for user 3ef60f9454534085840e5978491f4947 and project 58c4a340e93a4ec1993007691903a970. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:22:34.137312 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] [instance: 137011d3-2730-4503-861d-e8e488315db5] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:22:34.138303 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:34.138698 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:34.152334 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] [instance: 137011d3-2730-4503-861d-e8e488315db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:22:34.153611 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:34.153972 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:34.229812 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:34.230218 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-68c2c6e7-97a5-46ad-adf0-7ba8eb27096e tempest-ImagesOneServerTestJSON-37769702 tempest-ImagesOneServerTestJSON-37769702-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:48.968122 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:22:49.055800 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:49.056212 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:49.137525 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:49.138107 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:49.139015 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:49.139557 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:49.180192 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Getting quotas for project 9b09a5f426824ba2a6106a6722143a68. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:22:49.199617 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Getting quotas for user 7e923f4c6af04789a57e119362022a37 and project 9b09a5f426824ba2a6106a6722143a68. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:22:49.215598 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] [instance: 6e150a80-6e7f-4b29-8949-2b8d15480908] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:22:49.216570 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:49.217146 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:49.236434 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] [instance: 6e150a80-6e7f-4b29-8949-2b8d15480908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:22:49.239510 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:49.240333 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:49.305388 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:49.305959 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c0bac066-8a47-4612-bb90-31adbbc58f68 tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:52.225607 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:22:52.296487 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-365855b8-9e84-40bd-a7c5-25c4867522dd tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method rebuild_instance {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:22:52.298874 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-365855b8-9e84-40bd-a7c5-25c4867522dd tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:52.304106 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-365855b8-9e84-40bd-a7c5-25c4867522dd tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:52.305795 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:52.306455 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:52.352568 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-365855b8-9e84-40bd-a7c5-25c4867522dd tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] [instance: 0d46f5eb-e8db-400e-9aba-0667b1145d1c] No migration record for the rebuild/evacuate request. {{(pid=98810) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 02:22:52.423131 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:52.423942 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:52.424952 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:52.425556 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:52.465457 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Getting quotas for project f1d33dd44f5d4a24bcd7e92b086f54fa. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:22:52.470006 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Getting quotas for user 817c9243b45e451ca8a89467caff0019 and project f1d33dd44f5d4a24bcd7e92b086f54fa. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:22:52.494078 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] [instance: 7c1d0ded-f836-4e0b-baaf-c938ffddf2b8] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:22:52.497579 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:52.499246 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:52.514537 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] [instance: 7c1d0ded-f836-4e0b-baaf-c938ffddf2b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:22:52.516520 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:52.517146 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:52.595094 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:52.596125 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a48dc57c-8427-4866-bdce-473b956a8a27 tempest-LiveMigrationNegativeTest-932516380 tempest-LiveMigrationNegativeTest-932516380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:57.062925 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:22:57.093364 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:57.094029 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:57.168969 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:57.169857 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:57.170880 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:57.171543 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:57.191173 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Getting quotas for project 2e57a2a54bec44c489f7d6d8293cae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:22:57.195621 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Getting quotas for user e0e14e4815c14bf3a820f28fedf0d2f6 and project 2e57a2a54bec44c489f7d6d8293cae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:22:57.208956 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: bbf754d4-7ffd-4fd2-bec6-56391e3ea8b5] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:22:57.211021 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:57.211696 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:57.222456 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: bbf754d4-7ffd-4fd2-bec6-56391e3ea8b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:22:57.225356 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:57.225922 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:22:57.296739 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:22:57.297728 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1adb93ce-b357-4194-bcaa-8028c0cc2e32 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:25.865255 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:23:25.907766 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:25.909436 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:26.028862 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:26.029273 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:26.030473 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:26.030880 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:26.070963 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Getting quotas for project e82e093cd9924b7eb7e537a6440ce188. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:23:26.074509 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Getting quotas for user ae50228e44b74d63b5b4fbe40c1917a4 and project e82e093cd9924b7eb7e537a6440ce188. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:23:26.105394 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] [instance: bc31fd06-a54e-409f-ab34-92b651dc74cd] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:23:26.106439 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:26.106785 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:26.120770 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] [instance: bc31fd06-a54e-409f-ab34-92b651dc74cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:23:26.122298 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:26.122856 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:26.184586 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:26.184997 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8a002e01-86e3-4c2c-9d39-737c8ac9a908 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:26.784162 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:23:26.822052 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:26.822749 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:26.940544 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:26.943204 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:26.944148 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:26.945236 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:26.985994 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Getting quotas for project 6513484f1e5b4ea593c519cd47ef3008. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:23:26.994941 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Getting quotas for user 452cc5beae9a4908b5f84c393964ecc2 and project 6513484f1e5b4ea593c519cd47ef3008. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:23:27.022332 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] [instance: dc156f37-3e06-4d1b-aed6-372f22e86e01] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:23:27.023706 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:27.024303 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:27.043085 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] [instance: dc156f37-3e06-4d1b-aed6-372f22e86e01] block_device_mapping [BlockDeviceMapping(attachment_id=1dd15795-b333-4d01-83f8-64d5d6a44d69,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0c5ef0fc-25c6-436a-97e5-56e8008e9b23',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=d72a1595-f1cf-49ec-963a-0be63d9796d3,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='19ef87ab-4051-4d5a-90c2-bcf915699d7c',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=ed1dc07e-7be4-4d23-8d04-e2e34aeccc83,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2e3c2e1-bff9-4b43-b385-c52c2097342e',volume_size=1,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:23:27.045354 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:27.045959 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:27.061277 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:27.062063 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:27.075698 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:27.076361 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:27.142059 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:27.142600 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3214d251-ea66-43ba-aa10-efcd15d6cd17 tempest-TaggedBootDevicesTest-329074532 tempest-TaggedBootDevicesTest-329074532-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:27.503259 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-27cd4e33-b644-4383-a02d-379135e2305e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:23:27.507461 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-27cd4e33-b644-4383-a02d-379135e2305e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:27.508076 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-27cd4e33-b644-4383-a02d-379135e2305e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:28.089448 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-27cd4e33-b644-4383-a02d-379135e2305e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: bbf754d4-7ffd-4fd2-bec6-56391e3ea8b5] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98810) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 02:23:28.734792 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-27cd4e33-b644-4383-a02d-379135e2305e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Created allocations for migration a2d840bf-71d9-43aa-af4d-b60b9fb66a18 on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98810) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:23:29.236265 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-27cd4e33-b644-4383-a02d-379135e2305e tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: bbf754d4-7ffd-4fd2-bec6-56391e3ea8b5] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [Selection(allocation_request='{"allocations": {"1bff8e46-e9c8-450f-8078-657cbe80b915": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1bff8e46-e9c8-450f-8078-657cbe80b915"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=18c04405-93e8-4472-a3b7-1e908fd6a496,compute_node_uuid=1bff8e46-e9c8-450f-8078-657cbe80b915,limits=SchedulerLimits,nodename='n-h2-764292-25',service_host='n-h2-764292-25')] {{(pid=98810) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 02:23:34.921028 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-75d7edd5-62fb-4d6e-b1a3-766263e1c76e tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method rebuild_instance {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:23:34.921571 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-75d7edd5-62fb-4d6e-b1a3-766263e1c76e tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:34.922066 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-75d7edd5-62fb-4d6e-b1a3-766263e1c76e tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:34.979466 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-75d7edd5-62fb-4d6e-b1a3-766263e1c76e tempest-ServersAdminTestJSON-1435646919 tempest-ServersAdminTestJSON-1435646919-project] [instance: 0d46f5eb-e8db-400e-9aba-0667b1145d1c] No migration record for the rebuild/evacuate request. {{(pid=98809) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 02:23:38.841024 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-290991b4-1aaa-4d6c-b382-5a3ce393d788 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:23:38.842301 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-290991b4-1aaa-4d6c-b382-5a3ce393d788 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:38.843212 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-290991b4-1aaa-4d6c-b382-5a3ce393d788 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:39.300222 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-290991b4-1aaa-4d6c-b382-5a3ce393d788 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Created allocations for migration 029bd8b7-67cd-494e-9434-2c093d46a812 on 396f34e1-470a-4135-acc4-c392f4cd57ff {{(pid=98810) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:23:39.454218 n-d-764292-25 nova-conductor[98810]: DEBUG nova.scheduler.utils [None req-290991b4-1aaa-4d6c-b382-5a3ce393d788 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] [instance: 6e150a80-6e7f-4b29-8949-2b8d15480908] Instance allocations successfully created on destination node 1bff8e46-e9c8-450f-8078-657cbe80b915: {'allocations': {'1bff8e46-e9c8-450f-8078-657cbe80b915': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98810) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 02:23:39.454672 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-290991b4-1aaa-4d6c-b382-5a3ce393d788 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lazy-loading 'resources' on Instance uuid 6e150a80-6e7f-4b29-8949-2b8d15480908 {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:23:39.460861 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-290991b4-1aaa-4d6c-b382-5a3ce393d788 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6e150a80-6e7f-4b29-8949-2b8d15480908 {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:23:40.008336 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.live_migrate [None req-290991b4-1aaa-4d6c-b382-5a3ce393d788 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] [instance: 6e150a80-6e7f-4b29-8949-2b8d15480908] Start binding ports on destination host: n-h2-764292-25 {{(pid=98810) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 02:23:51.264164 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:23:51.318808 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:51.320171 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:51.425240 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:51.426474 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:51.427393 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:51.427959 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:51.448435 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Getting quotas for project 83ebc516c8d24f31a8d9268161b95c4d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:23:51.453245 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Getting quotas for user fc82470709fb4b6da410910907d65246 and project 83ebc516c8d24f31a8d9268161b95c4d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:23:51.464534 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] [instance: 05fa2699-0e23-44de-bfa6-44f18b5fe4f4] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:23:51.465773 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:51.466511 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:51.475683 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] [instance: 05fa2699-0e23-44de-bfa6-44f18b5fe4f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:23:51.477499 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:51.478065 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:23:51.522205 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:23:51.522707 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-6c0fd304-b8a3-4269-a234-51314f8e7f9a tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:17.152624 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:24:17.192086 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:17.192930 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:17.254426 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:17.255201 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:17.256271 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:17.256836 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:17.278101 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Getting quotas for project 2e57a2a54bec44c489f7d6d8293cae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:24:17.285589 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Getting quotas for user e0e14e4815c14bf3a820f28fedf0d2f6 and project 2e57a2a54bec44c489f7d6d8293cae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:24:17.297073 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: 4971a875-90c8-4868-9262-7430e560f4e5] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:24:17.298379 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:17.298998 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:17.309565 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: 4971a875-90c8-4868-9262-7430e560f4e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:24:17.311813 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:17.312459 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:17.359991 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:17.361829 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-89aaa286-b42b-4f7d-9f9e-5d47c50d2e04 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:57.589295 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:24:57.668634 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:57.670404 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:57.863451 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:57.863935 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:57.864753 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:57.865151 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:57.950534 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Getting quotas for project 83ebc516c8d24f31a8d9268161b95c4d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:24:57.961158 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Getting quotas for user fc82470709fb4b6da410910907d65246 and project 83ebc516c8d24f31a8d9268161b95c4d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:24:57.977947 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] [instance: 3b1a2d93-c179-4a94-981c-d5289d33f7d9] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:24:57.982816 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:57.983480 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:58.005958 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] [instance: 3b1a2d93-c179-4a94-981c-d5289d33f7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:24:58.007672 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:58.008440 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:24:58.095204 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:24:58.095622 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9c126f50-6a46-40ea-ab66-fa4fedee3dac tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:02.373011 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-7bf09c31-2eaf-4416-b0bf-1b6cf8e270e7 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:25:02.380852 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7bf09c31-2eaf-4416-b0bf-1b6cf8e270e7 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:02.389822 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7bf09c31-2eaf-4416-b0bf-1b6cf8e270e7 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:03.506261 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-7bf09c31-2eaf-4416-b0bf-1b6cf8e270e7 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: 4971a875-90c8-4868-9262-7430e560f4e5] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98810) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 02:25:04.121228 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-7bf09c31-2eaf-4416-b0bf-1b6cf8e270e7 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Created allocations for migration 65b35b04-ddb2-4956-9625-a0818472ac48 on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98810) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:25:04.512669 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-7bf09c31-2eaf-4416-b0bf-1b6cf8e270e7 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: 4971a875-90c8-4868-9262-7430e560f4e5] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [Selection(allocation_request='{"allocations": {"1bff8e46-e9c8-450f-8078-657cbe80b915": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1bff8e46-e9c8-450f-8078-657cbe80b915"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=18c04405-93e8-4472-a3b7-1e908fd6a496,compute_node_uuid=1bff8e46-e9c8-450f-8078-657cbe80b915,limits=SchedulerLimits,nodename='n-h2-764292-25',service_host='n-h2-764292-25')] {{(pid=98810) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 02:25:04.611244 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:25:04.657779 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:04.658620 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:04.779658 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:04.779968 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:04.781197 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:04.781762 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:04.824245 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Getting quotas for project b3b32a491648454e91bbab080c25ccec. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:25:04.834836 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Getting quotas for user ca9a1a2191c747e5936c0da200a149b0 and project b3b32a491648454e91bbab080c25ccec. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:25:04.856866 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] [instance: c03f613b-21e7-473f-9357-6e8f8eb74a1d] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:25:04.863092 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:04.863760 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:04.874466 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] [instance: c03f613b-21e7-473f-9357-6e8f8eb74a1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:25:04.876071 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:04.876853 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:04.962919 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:04.963406 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-67cba952-79f6-44de-9e61-db65ae744822 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:06.848662 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:25:06.893142 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:06.894622 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:06.989678 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:06.990503 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:06.992113 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:06.992744 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:07.029838 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:25:07.039048 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for user a96ea928e4f94856aed65d71275f140e and project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:25:07.061712 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: a83c2c43-0497-409f-b8e4-e4648d5f9ee1] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:25:07.063823 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:07.066113 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:07.098281 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: a83c2c43-0497-409f-b8e4-e4648d5f9ee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:25:07.099928 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:07.100556 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:07.153162 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:07.153694 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1283ccf3-a20b-4294-800d-6e6b0c19a67b tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:07.291074 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:25:07.356873 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:07.360212 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:07.529162 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:07.532530 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:07.535472 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:07.536076 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:07.609361 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Getting quotas for project 9b09a5f426824ba2a6106a6722143a68. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:25:07.632259 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Getting quotas for user 7e923f4c6af04789a57e119362022a37 and project 9b09a5f426824ba2a6106a6722143a68. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:25:07.684214 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] [instance: 6237cfa8-9c9e-4dfe-9308-a7ce3a1da388] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:25:07.686921 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:07.688090 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:07.719736 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] [instance: 6237cfa8-9c9e-4dfe-9308-a7ce3a1da388] block_device_mapping [BlockDeviceMapping(attachment_id=4bcb3b4c-4de0-441a-b519-42b595ffe2cb,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b606f345-3574-4f43-8a93-9cd2097fca03',volume_size=1,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:25:07.721838 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:07.729430 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:07.833738 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:07.834442 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e9abefef-5d28-45ee-827a-cab83f4dee8d tempest-LiveMigrationTest-831317196 tempest-LiveMigrationTest-831317196-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:08.124535 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:25:08.207978 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:08.211207 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:08.339543 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:08.339953 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:08.342587 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:08.343239 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:08.385885 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Getting quotas for project b3b32a491648454e91bbab080c25ccec. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:25:08.393940 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Getting quotas for user ca9a1a2191c747e5936c0da200a149b0 and project b3b32a491648454e91bbab080c25ccec. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:25:08.419034 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] [instance: d2f32e5c-50dd-466e-8719-481eeae828ad] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:25:08.420341 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:08.422514 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:08.438518 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] [instance: d2f32e5c-50dd-466e-8719-481eeae828ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:25:08.442336 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:08.443069 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:08.515587 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:08.516261 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dabcea0-11de-4996-b4ac-3db92e6895c7 tempest-ListImageFiltersTestJSON-1015021623 tempest-ListImageFiltersTestJSON-1015021623-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:14.646273 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:25:15.702852 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 33944. May 28 02:25:24.595300 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:25:24.616772 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:24.617185 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:24.748639 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:24.749304 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:24.751226 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:24.751628 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:24.772965 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Getting quotas for project 465aea9db2fa4f749a896a5506add0ae. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:25:24.777725 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Getting quotas for user aa350ede9aaf4fbf9828ddf1aa7a95d4 and project 465aea9db2fa4f749a896a5506add0ae. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:25:24.789726 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] [instance: 61bb287a-73ca-46d7-ae84-480bc609f9b5] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:25:24.790940 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:24.791505 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:24.800363 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] [instance: 61bb287a-73ca-46d7-ae84-480bc609f9b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a08980a-7aed-4850-b16e-9b3c81dc1635',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:25:24.802902 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:24.804565 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:24.845035 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:24.845917 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2b301d30-a6d3-4b03-a52a-6be3b3380318 tempest-AttachSCSIVolumeTestJSON-1080989414 tempest-AttachSCSIVolumeTestJSON-1080989414-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:36.998463 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:36.998968 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:37.355154 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Took 0.32 seconds to select destinations for 2 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:25:37.379084 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:37.379512 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:37.430779 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:37.431109 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:37.480502 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:37.480913 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:37.481803 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:37.482234 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:37.498303 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:25:37.501852 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for user a96ea928e4f94856aed65d71275f140e and project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:25:37.511442 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: 6474e369-9edb-4863-b0ab-9b8f8315b842] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:25:37.512420 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:37.512829 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:37.520816 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: 6474e369-9edb-4863-b0ab-9b8f8315b842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:25:37.522146 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:37.522643 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:37.554411 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:37.554933 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:37.565444 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: 5ccc93df-175e-4531-8775-b11f233f770e] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:25:37.566013 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance_group [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lazy-loading 'hosts' on InstanceGroup uuid d65d76bd-0266-4433-94d2-d6637f238ebd {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} May 28 02:25:37.576593 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:37.577003 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:37.587599 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: 5ccc93df-175e-4531-8775-b11f233f770e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:25:37.588815 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:37.589255 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:37.627133 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:37.627851 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8e34724c-cdb0-4682-bc15-76e064d56ae6 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:38.849931 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-684fcb76-39a2-4cb8-8db8-007acf18e437 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:25:38.850546 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-684fcb76-39a2-4cb8-8db8-007acf18e437 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:25:38.850879 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-684fcb76-39a2-4cb8-8db8-007acf18e437 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:25:39.161805 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-684fcb76-39a2-4cb8-8db8-007acf18e437 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Created allocations for migration c83aec4e-719f-4a25-a403-ac0ae67ac4e0 on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:25:39.270900 n-d-764292-25 nova-conductor[98809]: DEBUG nova.scheduler.utils [None req-684fcb76-39a2-4cb8-8db8-007acf18e437 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] [instance: 6237cfa8-9c9e-4dfe-9308-a7ce3a1da388] Instance allocations successfully created on destination node 396f34e1-470a-4135-acc4-c392f4cd57ff: {'allocations': {'396f34e1-470a-4135-acc4-c392f4cd57ff': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=98809) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 02:25:39.271333 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance [None req-684fcb76-39a2-4cb8-8db8-007acf18e437 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lazy-loading 'resources' on Instance uuid 6237cfa8-9c9e-4dfe-9308-a7ce3a1da388 {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:25:39.275947 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance [None req-684fcb76-39a2-4cb8-8db8-007acf18e437 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6237cfa8-9c9e-4dfe-9308-a7ce3a1da388 {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:25:40.603957 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.live_migrate [None req-684fcb76-39a2-4cb8-8db8-007acf18e437 tempest-LiveMigrationTest-163086492 tempest-LiveMigrationTest-163086492-project-admin] [instance: 6237cfa8-9c9e-4dfe-9308-a7ce3a1da388] Start binding ports on destination host: n-h1-764292-25 {{(pid=98809) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 02:26:12.368541 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:26:12.438710 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:26:12.459746 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:12.460916 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:12.538830 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:12.539394 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:12.540196 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:12.540585 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:12.575740 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Getting quotas for project 2e57a2a54bec44c489f7d6d8293cae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:26:12.582413 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Getting quotas for user e0e14e4815c14bf3a820f28fedf0d2f6 and project 2e57a2a54bec44c489f7d6d8293cae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:26:12.596337 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: 61029940-3412-4406-83bc-4d784bf73a17] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:26:12.597741 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:12.598375 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:12.612560 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] [instance: 61029940-3412-4406-83bc-4d784bf73a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:26:12.614467 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:12.615479 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:12.669704 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:12.670455 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8495380b-c556-4c49-895b-669a11b095b8 tempest-MigrationsAdminTest-1269261205 tempest-MigrationsAdminTest-1269261205-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:15.143017 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:15.143518 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:15.762516 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Took 0.55 seconds to select destinations for 2 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:26:15.797001 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:15.797691 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:15.883267 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:15.883684 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:16.055662 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:16.056065 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:16.056788 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:16.057245 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:16.094972 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:26:16.103982 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for user a96ea928e4f94856aed65d71275f140e and project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:26:16.121469 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: 13865e76-0120-48a2-b8ad-e34f1f66ddd2] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:26:16.122736 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:16.123348 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:16.147600 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: 13865e76-0120-48a2-b8ad-e34f1f66ddd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:26:16.150109 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:16.151467 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:16.229534 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:16.230226 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:16.248486 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: d31304a7-660b-4f41-bd40-3e322fab8f9d] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:26:16.249338 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance_group [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lazy-loading 'hosts' on InstanceGroup uuid cfbb2406-5140-429d-abca-c646f2efd46c {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} May 28 02:26:16.264784 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:16.265503 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:16.277197 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: d31304a7-660b-4f41-bd40-3e322fab8f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:26:16.280068 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:16.280715 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:16.373405 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:16.373725 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c25df421-c29e-425b-a374-c7069783c9bf tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:25.602519 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:26:25.636660 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:25.637323 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:25.691950 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:25.692706 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:25.693711 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:25.694281 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:25.715442 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Getting quotas for project 83ebc516c8d24f31a8d9268161b95c4d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:26:25.720950 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Getting quotas for user fc82470709fb4b6da410910907d65246 and project 83ebc516c8d24f31a8d9268161b95c4d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:26:25.732483 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] [instance: b51d0361-7bb1-43f6-810c-2f97dcdd2585] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:26:25.733655 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:25.734369 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:25.753090 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] [instance: b51d0361-7bb1-43f6-810c-2f97dcdd2585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:26:25.755926 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:25.757707 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:25.833787 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:25.834341 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dcba6c94-54a8-45d1-b2fc-abec7cc5e342 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:29.625310 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:26:30.649534 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 35378. May 28 02:26:41.383716 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a8cd027e-fa9e-410a-826e-2258094f728e tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:26:41.390259 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a8cd027e-fa9e-410a-826e-2258094f728e tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:41.391659 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a8cd027e-fa9e-410a-826e-2258094f728e tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:41.605707 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-a8cd027e-fa9e-410a-826e-2258094f728e tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] [instance: 61029940-3412-4406-83bc-4d784bf73a17] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98809) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 02:26:42.095632 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-a8cd027e-fa9e-410a-826e-2258094f728e tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] Created allocations for migration 7f06fd07-994e-43d7-bbb5-d122e2624cd6 on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:26:42.439947 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-a8cd027e-fa9e-410a-826e-2258094f728e tempest-MigrationsAdminTest-442328547 tempest-MigrationsAdminTest-442328547-project-admin] [instance: 61029940-3412-4406-83bc-4d784bf73a17] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98809) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 02:26:46.211367 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:26:46.236298 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:46.236809 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:46.288423 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:46.289135 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:46.290834 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:46.291500 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:46.310462 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:26:46.315544 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for user a96ea928e4f94856aed65d71275f140e and project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:26:46.326111 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: 880ce19d-f626-4907-a813-ed9dca762a9a] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:26:46.327252 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:46.327724 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:46.337224 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: 880ce19d-f626-4907-a813-ed9dca762a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:26:46.339437 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:46.339851 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:46.403642 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:46.406609 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9db0b673-a31b-4f90-bfc9-fa627874ed21 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:55.044644 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:26:57.200366 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:26:57.231669 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:57.232109 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:57.296196 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:57.296610 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:57.297341 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:57.297735 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:57.316001 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Getting quotas for project bf565749d720498b89585de4f8281330. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:26:57.320099 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Getting quotas for user e4282c2c609445c085d6c76529abb357 and project bf565749d720498b89585de4f8281330. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:26:57.331949 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] [instance: 805a8e71-eb55-407c-9b0d-8e78b737c662] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:26:57.332967 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:57.333440 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:57.340710 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] [instance: 805a8e71-eb55-407c-9b0d-8e78b737c662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:26:57.342213 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:57.343121 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:26:57.375240 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:26:57.375882 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-7e95a740-5230-4009-8be7-e4f598e6ff2d tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:17.210997 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:27:17.239625 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:17.240040 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:17.298531 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:17.299041 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:17.299717 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:17.300099 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:17.317480 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Getting quotas for project 63f5521335ac45e3b4fbeb0c296d922e. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:27:17.321246 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Getting quotas for user 6e8525c80367417bb7802a86759ebfae and project 63f5521335ac45e3b4fbeb0c296d922e. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:27:17.331475 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] [instance: 2b3d66f7-b219-4af1-94cd-897c86304b5e] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:27:17.332478 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:17.332846 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:17.340269 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] [instance: 2b3d66f7-b219-4af1-94cd-897c86304b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:27:17.341479 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:17.341890 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:17.376848 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:17.377489 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-441f2b88-ae2b-48cd-a7a7-3f289d2a09e8 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631 tempest-FloatingIPsAssociationNegativeTestJSON-1496592631-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:18.529143 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:27:18.576507 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:18.577133 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:18.673629 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:18.674691 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:18.675813 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:18.680054 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:18.742492 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:27:18.753597 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for user a96ea928e4f94856aed65d71275f140e and project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:27:18.792843 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: f196be67-8467-46a4-97c6-aca8ce75b75f] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:27:18.793917 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:18.796878 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:18.815394 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: f196be67-8467-46a4-97c6-aca8ce75b75f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:27:18.817225 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:18.817842 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:18.883928 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:18.885220 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3d288d76-c177-42f0-86fd-df5cc0f2a822 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:22.824580 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:27:22.851212 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:22.852079 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:22.914079 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:22.914764 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:22.915785 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:22.916619 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:22.938961 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Getting quotas for project 83ebc516c8d24f31a8d9268161b95c4d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:27:22.944262 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Getting quotas for user fc82470709fb4b6da410910907d65246 and project 83ebc516c8d24f31a8d9268161b95c4d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:27:22.956365 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] [instance: 96d7b8f0-1661-4314-9028-7ff6e61038b0] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:27:22.957877 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:22.958565 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:22.968741 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] [instance: 96d7b8f0-1661-4314-9028-7ff6e61038b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:27:22.971631 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:22.972503 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:23.019674 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:23.020640 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ef35f71e-8239-43c2-9a1b-5d8ad2e148f1 tempest-ImagesTestJSON-143066150 tempest-ImagesTestJSON-143066150-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:25.758193 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:27:25.794577 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:25.795216 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:25.860158 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:25.862869 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:25.864711 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:25.865279 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:25.886943 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Getting quotas for project e82e093cd9924b7eb7e537a6440ce188. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:27:25.890897 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Getting quotas for user ae50228e44b74d63b5b4fbe40c1917a4 and project e82e093cd9924b7eb7e537a6440ce188. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:27:25.907753 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] [instance: 02245e99-71bb-428f-a8c5-49543c4db880] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:27:25.909481 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:25.909951 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:25.919591 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] [instance: 02245e99-71bb-428f-a8c5-49543c4db880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:27:25.920740 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:25.921265 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:25.930379 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:25.930816 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:25.973816 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:25.977821 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d387047d-66cd-4d9c-b681-74996b514dd6 tempest-ServersWithSpecificFlavorTestJSON-103726452 tempest-ServersWithSpecificFlavorTestJSON-103726452-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:28.945256 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:27:28.974563 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:28.975249 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:29.024127 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:29.024634 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:29.025437 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:29.025907 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:29.042491 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Getting quotas for project bf565749d720498b89585de4f8281330. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:27:29.046268 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Getting quotas for user e4282c2c609445c085d6c76529abb357 and project bf565749d720498b89585de4f8281330. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:27:29.056717 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] [instance: ecd7a96b-f37f-404b-8afa-105aef37ce74] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:27:29.057750 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:29.058246 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:29.067295 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] [instance: ecd7a96b-f37f-404b-8afa-105aef37ce74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:27:29.069080 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:29.069673 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:29.102699 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:29.103313 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1d56fd23-71ac-40cf-8a6f-5b80d3b71e28 tempest-ServersAdminNegativeTestJSON-1432328443 tempest-ServersAdminNegativeTestJSON-1432328443-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:42.109373 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:27:42.133571 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:42.134182 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:42.181251 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:42.181689 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:42.182463 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:42.182861 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:42.198977 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:27:42.203983 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Getting quotas for user a96ea928e4f94856aed65d71275f140e and project f43dbaf7bdf94200aee2d1bcbb07e961. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:27:42.213757 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: 9ff2640c-6d66-4a3d-8ffe-48467b98d287] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:27:42.215427 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:42.215856 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:42.223782 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] [instance: 9ff2640c-6d66-4a3d-8ffe-48467b98d287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:27:42.225065 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:42.225668 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:27:42.260826 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:27:42.262432 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d6434a29-4945-4070-9b06-be72ea1b0714 tempest-ServersOnMultiNodesTest-1413719921 tempest-ServersOnMultiNodesTest-1413719921-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:15.166916 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:28:15.215643 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:15.216789 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:15.304304 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:15.305605 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:15.306577 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:15.307132 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:15.342373 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Getting quotas for project 0ec9516e53f241198dce9a615cda074c. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:28:15.349799 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Getting quotas for user 4324bbea4cf9486482d111931a126f72 and project 0ec9516e53f241198dce9a615cda074c. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:28:15.365363 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] [instance: 32331600-1418-49f2-9714-14d1627edad7] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:28:15.366967 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:15.368059 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:15.378680 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] [instance: 32331600-1418-49f2-9714-14d1627edad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:28:15.382852 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:15.383446 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:15.456182 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:15.456807 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60b71482-4e6d-45f1-8c48-03ec5dea0d35 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:15.667163 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:28:16.698393 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 37716. May 28 02:28:30.642051 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:28:30.683168 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:30.688768 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:30.798030 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:30.798855 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:30.799940 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:30.800397 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:30.818819 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Getting quotas for project bfee8638bcc3459cb898812dcd90eec5. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:28:30.822706 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Getting quotas for user e68e0f1a60634cb09dfce30b022c008b and project bfee8638bcc3459cb898812dcd90eec5. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:28:30.834041 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] [instance: 66952afb-929f-452b-95b6-cc86bafceb94] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:28:30.835192 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:30.835611 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:30.846430 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] [instance: 66952afb-929f-452b-95b6-cc86bafceb94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:28:30.847963 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:30.850611 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:30.915825 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:30.916489 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d261d52b-0fc7-4825-ab77-f28df6ba1cf9 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:41.183433 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:28:41.206088 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:41.206598 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:41.264504 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:41.265096 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:41.266614 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:41.267228 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:41.284227 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Getting quotas for project f5fafc75013d4f3eb4b2903f3aed7d80. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:28:41.287962 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Getting quotas for user bc8a27435637405d99b01fd8347437db and project f5fafc75013d4f3eb4b2903f3aed7d80. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:28:41.298225 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] [instance: 226ace4f-1ac2-41fd-b461-0dab2c65a85a] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:28:41.299314 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:41.299788 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:41.306738 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] [instance: 226ace4f-1ac2-41fd-b461-0dab2c65a85a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:28:41.308153 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:41.308630 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:41.339592 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:41.340316 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-da37bb6c-614a-47f2-856d-30a6934dbc6a tempest-ServerTagsTestJSON-319177562 tempest-ServerTagsTestJSON-319177562-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:43.993087 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:28:44.018470 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:44.019202 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:44.086281 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:44.087084 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:44.088145 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:44.089247 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:44.111647 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Getting quotas for project e9ba15c4b6ed4597b7dfe15961f03edc. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:28:44.115731 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Getting quotas for user 49af63af38d84891895fea58313ae702 and project e9ba15c4b6ed4597b7dfe15961f03edc. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:28:44.126315 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] [instance: 04749d2b-e775-4335-96cb-fa487b5a3cc6] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:28:44.127493 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:44.127871 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:44.136526 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] [instance: 04749d2b-e775-4335-96cb-fa487b5a3cc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:28:44.138358 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:44.138801 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:44.178751 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:44.179536 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-64bd9d86-fd32-4a1f-9412-3201ef78943c tempest-VolumesAdminNegativeTest-2101713776 tempest-VolumesAdminNegativeTest-2101713776-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:54.242032 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-fe58acdd-2f22-4e61-a9a3-635ed5c5e4f7 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method rebuild_instance {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:28:54.242669 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fe58acdd-2f22-4e61-a9a3-635ed5c5e4f7 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:28:54.243057 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fe58acdd-2f22-4e61-a9a3-635ed5c5e4f7 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:28:54.260073 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-fe58acdd-2f22-4e61-a9a3-635ed5c5e4f7 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] [instance: 66952afb-929f-452b-95b6-cc86bafceb94] No migration record for the rebuild/evacuate request. {{(pid=98810) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 02:29:02.775102 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:29:02.854393 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:02.854825 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:02.990858 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:02.991934 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:02.993003 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:02.994364 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:03.037220 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Getting quotas for project 0ec9516e53f241198dce9a615cda074c. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:29:03.054499 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Getting quotas for user 4324bbea4cf9486482d111931a126f72 and project 0ec9516e53f241198dce9a615cda074c. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:29:03.070598 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] [instance: bd29e7b4-70b6-4850-9978-879d92ae6f32] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:29:03.071684 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:03.072160 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:03.092823 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] [instance: bd29e7b4-70b6-4850-9978-879d92ae6f32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:29:03.094623 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:03.095087 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:03.167298 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:03.167819 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4b1879e4-5e82-418c-aa9d-b2c186c7d312 tempest-SecurityGroupsTestJSON-1550475143 tempest-SecurityGroupsTestJSON-1550475143-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:06.371413 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:29:06.416705 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:06.417327 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:06.527864 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:06.529141 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:06.531526 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:06.531992 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:06.572292 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Getting quotas for project 8a1ddea0a3d249cb982d1a8fd7f07348. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:29:06.585536 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Getting quotas for user d77ce0a6a3994af1b7735b9e0ca72ccc and project 8a1ddea0a3d249cb982d1a8fd7f07348. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:29:06.610654 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] [instance: 588ed0d8-c74d-45b4-94e0-a327cc97b0e1] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:29:06.611623 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:06.612030 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:06.626937 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] [instance: 588ed0d8-c74d-45b4-94e0-a327cc97b0e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:29:06.628545 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:06.629112 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:06.690390 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:06.691017 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-58174c9a-722e-431f-909a-1a615b1d023e tempest-ImagesNegativeTestJSON-884103255 tempest-ImagesNegativeTestJSON-884103255-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:14.287948 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:29:14.323828 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:14.324236 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:14.375038 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:14.375359 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:14.376082 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:14.376555 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:14.392897 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Getting quotas for project aa30cea74bbf4535be74d77b23e5ec83. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:29:14.396594 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Getting quotas for user 45acc1017f7048379c3d5a3e90238ac8 and project aa30cea74bbf4535be74d77b23e5ec83. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:29:14.406577 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] [instance: a0f33e4a-58c1-43e1-acd0-ec69bd6affc6] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:29:14.407510 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:14.407914 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:14.415930 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] [instance: a0f33e4a-58c1-43e1-acd0-ec69bd6affc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:29:14.417640 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:14.418022 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:14.466016 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:14.466884 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d102c20-4f9c-4dce-8574-b987a0ad1bc2 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:20.997214 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:29:21.025087 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:21.025935 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:21.168372 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:21.168782 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:21.171659 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:21.172506 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:21.194623 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Getting quotas for project b893b4f2164940dd8c93efa05eb759de. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:29:21.203209 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Getting quotas for user 75a937418a734df5b2aab042b7b64298 and project b893b4f2164940dd8c93efa05eb759de. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:29:21.230017 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] [instance: 3b3ea1cb-3b35-460b-abca-a8ba6954b6ee] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:29:21.231238 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:21.231804 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:21.249499 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] [instance: 3b3ea1cb-3b35-460b-abca-a8ba6954b6ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:29:21.250881 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:21.251293 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:21.331736 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:21.332276 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-25c2852b-33e8-4eff-847f-8c49abbdb180 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:25.904221 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2721b581-283d-4a8e-874a-e2e1cf6ebbc0 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method rebuild_instance {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:29:25.905935 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2721b581-283d-4a8e-874a-e2e1cf6ebbc0 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:25.906544 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2721b581-283d-4a8e-874a-e2e1cf6ebbc0 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:25.935677 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2721b581-283d-4a8e-874a-e2e1cf6ebbc0 tempest-ServerShowV257Test-1767579854 tempest-ServerShowV257Test-1767579854-project] [instance: a0f33e4a-58c1-43e1-acd0-ec69bd6affc6] No migration record for the rebuild/evacuate request. {{(pid=98809) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 02:29:30.352929 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:29:30.383019 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:30.383679 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:30.438549 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:30.439252 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:30.440145 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:30.440703 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:30.458850 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Getting quotas for project bfee8638bcc3459cb898812dcd90eec5. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:29:30.462910 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Getting quotas for user e68e0f1a60634cb09dfce30b022c008b and project bfee8638bcc3459cb898812dcd90eec5. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:29:30.473606 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] [instance: f292196e-d7e0-4cf9-8b7b-43b6b4cae16f] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:29:30.474879 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:30.475444 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:30.487606 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] [instance: f292196e-d7e0-4cf9-8b7b-43b6b4cae16f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:29:30.490456 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:30.493188 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:30.534112 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:30.534838 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-851ec18f-5835-4930-9dcb-d7f3ebaa62bd tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:30.649818 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:29:31.705722 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 39126. May 28 02:29:41.280581 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:29:41.303017 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:41.303431 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:41.362325 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:41.362852 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:41.363637 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:41.364040 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:41.390027 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Getting quotas for project b893b4f2164940dd8c93efa05eb759de. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:29:41.393704 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Getting quotas for user 75a937418a734df5b2aab042b7b64298 and project b893b4f2164940dd8c93efa05eb759de. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:29:41.404845 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] [instance: cecd24e1-bf57-4c33-858a-dc7548d5da52] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:29:41.406278 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:41.406683 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:41.415192 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] [instance: cecd24e1-bf57-4c33-858a-dc7548d5da52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:29:41.417178 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:41.417527 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:41.455200 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:41.456389 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-57f0f353-47bf-4ec0-a288-d4e75115caa5 tempest-FloatingIPsAssociationTestJSON-1512563065 tempest-FloatingIPsAssociationTestJSON-1512563065-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:48.492134 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:29:48.518791 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:48.520380 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:48.576015 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:48.576526 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:48.577392 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:48.577878 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:48.596454 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Getting quotas for project aa0673c76f084e909b30dd24a1b3789b. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:29:48.600418 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Getting quotas for user ab586eadb79347448a21f84d24fa52bc and project aa0673c76f084e909b30dd24a1b3789b. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:29:48.612197 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] [instance: 98c2389a-1868-400c-a118-f9ffdb6bbca3] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:29:48.613430 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:48.614286 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:48.624653 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] [instance: 98c2389a-1868-400c-a118-f9ffdb6bbca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:29:48.626232 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:48.626805 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:48.665244 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:48.665707 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-cdf5bbd8-8d7c-4157-9a6d-8abbbca180e8 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:51.527701 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9b394998-c379-46de-901f-64b2efaaa3d8 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method rebuild_instance {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:29:51.530725 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9b394998-c379-46de-901f-64b2efaaa3d8 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:29:51.531287 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9b394998-c379-46de-901f-64b2efaaa3d8 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:29:51.579704 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9b394998-c379-46de-901f-64b2efaaa3d8 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] [instance: f292196e-d7e0-4cf9-8b7b-43b6b4cae16f] No migration record for the rebuild/evacuate request. {{(pid=98809) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 02:30:44.898677 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:30:44.927629 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:44.928398 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:45.007549 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:45.007961 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:45.008703 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:45.009333 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:45.037157 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Getting quotas for project 9843cb0314fc4446b553ff905f2849f5. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:30:45.041837 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Getting quotas for user 3d69157a90f44dfbab8ecd0c1213cb35 and project 9843cb0314fc4446b553ff905f2849f5. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:30:45.055743 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] [instance: 16f99d30-52c0-4d28-bc83-c74ef73585a0] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:30:45.056780 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:45.057388 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:45.064648 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] [instance: 16f99d30-52c0-4d28-bc83-c74ef73585a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:30:45.066087 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:45.066604 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:45.111347 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:45.112079 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1eb12c02-6ce7-4c76-8666-0546b781df1e tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:46.321823 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:30:46.345284 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:46.345692 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:46.400599 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:46.401202 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:46.402149 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:46.402733 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:46.421755 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Getting quotas for project ffefab98a5184f9f8d9b6fb858584c63. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:30:46.426083 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Getting quotas for user 9a1d4a0409024b1bb510017fbed897e3 and project ffefab98a5184f9f8d9b6fb858584c63. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:30:46.439613 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] [instance: fd9a55a9-db57-4d92-9d66-9a75f1ad4f62] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:30:46.440771 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:46.441465 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:46.451772 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] [instance: fd9a55a9-db57-4d92-9d66-9a75f1ad4f62] block_device_mapping [BlockDeviceMapping(attachment_id=482c0539-d96f-4bd8-9170-9d9d27552e5c,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a59fdeed-c0ab-4289-9606-0bd9f929461b',volume_size=1,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:30:46.453397 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:46.454020 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:46.493128 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:46.495188 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-28e27b31-16df-4fe3-9be4-3557db2a3249 tempest-ServersTestBootFromVolume-793359446 tempest-ServersTestBootFromVolume-793359446-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:48.429099 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:30:48.477461 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:48.478419 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:48.585924 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:48.586357 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:48.587078 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:48.587991 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:48.621008 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Getting quotas for project bfee8638bcc3459cb898812dcd90eec5. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:30:48.626700 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Getting quotas for user e68e0f1a60634cb09dfce30b022c008b and project bfee8638bcc3459cb898812dcd90eec5. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:30:48.637248 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] [instance: 59e5ba0d-30b8-474d-88fb-776df051b701] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:30:48.645622 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:48.646094 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:48.655955 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] [instance: 59e5ba0d-30b8-474d-88fb-776df051b701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:30:48.657469 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:48.657956 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:30:48.707986 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:30:48.708691 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6bcb033a-1d19-4855-90b5-2ec09a43a370 tempest-ServerDiskConfigTestJSON-524661838 tempest-ServerDiskConfigTestJSON-524661838-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:11.531053 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:31:11.571924 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:11.574828 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:11.675600 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:11.676262 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:11.677172 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:11.677734 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:11.720612 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Getting quotas for project aa0673c76f084e909b30dd24a1b3789b. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:31:11.725462 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Getting quotas for user ab586eadb79347448a21f84d24fa52bc and project aa0673c76f084e909b30dd24a1b3789b. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:31:11.738472 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] [instance: 59cc1ef5-6cfe-4f13-ad5f-a8c28235b018] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:31:11.739629 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:11.740213 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:11.749926 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] [instance: 59cc1ef5-6cfe-4f13-ad5f-a8c28235b018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:31:11.751590 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:11.752269 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:11.798026 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:11.798897 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4e7d41c9-84ff-440d-86a2-df9489df5068 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:12.483003 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:31:16.694934 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:31:17.717840 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40894. May 28 02:31:34.076916 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:31:34.134167 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:34.134932 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:34.213072 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:34.213752 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:34.214785 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:34.215410 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:34.241321 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Getting quotas for project 0196924e00d64a1fad157a92e0291fa5. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:31:34.247375 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Getting quotas for user a81941045ed54724b6ca091dcb62001a and project 0196924e00d64a1fad157a92e0291fa5. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:31:34.264458 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] [instance: 42a5ee82-2d3a-4214-8b29-bef77141de5e] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:31:34.265501 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:34.266663 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:34.285694 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] [instance: 42a5ee82-2d3a-4214-8b29-bef77141de5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:31:34.287967 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:34.288703 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:34.334624 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:34.335127 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-042cce1d-9e3f-4d7d-a233-6cb7af5312c4 tempest-ServersTestManualDisk-319957814 tempest-ServersTestManualDisk-319957814-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:44.527973 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:31:44.592256 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:44.592602 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:44.691658 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:44.692061 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:44.692790 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:44.693181 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:44.744679 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Getting quotas for project f05dcc1a319241a383027874156ff969. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:31:44.762820 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Getting quotas for user c56e704222fc475e9093b314aa0027f9 and project f05dcc1a319241a383027874156ff969. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:31:44.800642 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] [instance: 4c4988cd-e04b-4281-ad60-2221d9bd018c] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:31:44.806401 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:44.806889 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:44.824503 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] [instance: 4c4988cd-e04b-4281-ad60-2221d9bd018c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:31:44.826035 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:44.826505 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:44.921720 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:44.921963 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-41eda1ab-88f7-42fd-baf2-a1ecff90de3d tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:55.078003 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:31:57.340334 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:31:57.368548 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:57.369061 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:57.483477 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:57.483970 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:57.484896 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:57.485354 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:57.501865 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Getting quotas for project aa0673c76f084e909b30dd24a1b3789b. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:31:57.505894 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Getting quotas for user ab586eadb79347448a21f84d24fa52bc and project aa0673c76f084e909b30dd24a1b3789b. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:31:57.527189 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] [instance: 447ddc98-ab43-4fa9-83f0-d74fcffed1ef] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:31:57.528800 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:57.529212 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:57.541313 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] [instance: 447ddc98-ab43-4fa9-83f0-d74fcffed1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:31:57.542520 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:57.542931 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:31:57.607231 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:31:57.607820 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-65513a35-f407-45d2-9ed6-afd48d3a1639 tempest-ImagesOneServerNegativeTestJSON-1476663896 tempest-ImagesOneServerNegativeTestJSON-1476663896-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:25.575145 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:32:25.618560 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:25.619120 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:25.713183 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:25.713933 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:25.715892 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:25.716561 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:25.738209 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Getting quotas for project 158a0c2904774f658e263f360fdc3835. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:32:25.746092 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Getting quotas for user 2b1b9046ea744d588725a2f07ad4d051 and project 158a0c2904774f658e263f360fdc3835. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:32:25.761683 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] [instance: 9c9642e3-9023-4921-882e-069be349f82d] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:32:25.763699 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:25.764306 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:25.773741 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] [instance: 9c9642e3-9023-4921-882e-069be349f82d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:32:25.775197 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:25.775979 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:25.832089 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:25.832519 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-918a3425-e8fa-4d1a-a884-5936a89d1bcc tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:31.685164 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:32:32.717269 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43124. May 28 02:32:34.391923 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:32:34.419044 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:34.419450 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:34.476331 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:34.476767 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:34.477491 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:34.477880 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:34.496049 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Getting quotas for project f05dcc1a319241a383027874156ff969. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:32:34.500125 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Getting quotas for user c56e704222fc475e9093b314aa0027f9 and project f05dcc1a319241a383027874156ff969. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:32:34.512626 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] [instance: 840cc05f-e5b1-484e-a9ef-f5278ba2050d] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:32:34.513904 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:34.514344 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:34.524356 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] [instance: 840cc05f-e5b1-484e-a9ef-f5278ba2050d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:32:34.526217 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:34.526920 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:34.562931 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:34.563571 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3dab4b46-5fd4-4332-bbb7-f0e832e300bd tempest-ServersTestMultiNic-1273760998 tempest-ServersTestMultiNic-1273760998-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:42.146371 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:32:42.189735 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:42.192912 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:42.264358 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:42.265118 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:42.267087 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:42.267987 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:42.287950 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:32:42.291926 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for user 6218a0b0b4574c31a66bf6a5b0c667d4 and project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:32:42.302739 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: c447bca1-eade-43bc-92b5-fd8df550f8f6] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:32:42.303894 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:42.304309 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:42.315275 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: c447bca1-eade-43bc-92b5-fd8df550f8f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:32:42.317145 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:42.318338 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:42.361611 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:42.361950 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-acb3b6ee-f7fb-46e5-b141-870e17b34ded tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:48.892413 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-4d7b3c8d-a2bc-4e42-8d8f-575c052aef61 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:32:48.893878 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4d7b3c8d-a2bc-4e42-8d8f-575c052aef61 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:32:48.894486 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4d7b3c8d-a2bc-4e42-8d8f-575c052aef61 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:32:49.601474 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-4d7b3c8d-a2bc-4e42-8d8f-575c052aef61 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Created allocations for migration 4abd879f-5b54-4956-80ca-6274bf6faa8d on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98810) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:32:49.843676 n-d-764292-25 nova-conductor[98810]: DEBUG nova.scheduler.utils [None req-4d7b3c8d-a2bc-4e42-8d8f-575c052aef61 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] [instance: 9c9642e3-9023-4921-882e-069be349f82d] Instance allocations successfully created on destination node 396f34e1-470a-4135-acc4-c392f4cd57ff: {'allocations': {'396f34e1-470a-4135-acc4-c392f4cd57ff': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98810) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 02:32:49.843676 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-4d7b3c8d-a2bc-4e42-8d8f-575c052aef61 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lazy-loading 'resources' on Instance uuid 9c9642e3-9023-4921-882e-069be349f82d {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:32:49.848246 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-4d7b3c8d-a2bc-4e42-8d8f-575c052aef61 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lazy-loading 'pci_requests' on Instance uuid 9c9642e3-9023-4921-882e-069be349f82d {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:32:50.313049 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.live_migrate [None req-4d7b3c8d-a2bc-4e42-8d8f-575c052aef61 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] [instance: 9c9642e3-9023-4921-882e-069be349f82d] Start binding ports on destination host: n-h1-764292-25 {{(pid=98810) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 02:33:09.696690 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:33:09.741176 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:09.743366 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:09.838287 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:09.838687 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:09.839473 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:09.839870 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:09.875972 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Getting quotas for project 158a0c2904774f658e263f360fdc3835. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:33:09.882900 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Getting quotas for user 2b1b9046ea744d588725a2f07ad4d051 and project 158a0c2904774f658e263f360fdc3835. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:33:09.908268 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] [instance: a1097a02-b9f4-4955-840e-3341f4011b93] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:33:09.909235 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:09.909709 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:09.923992 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] [instance: a1097a02-b9f4-4955-840e-3341f4011b93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:33:09.925251 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:09.925659 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:09.973484 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:09.973883 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2de33146-9efc-4043-ab63-e216e62f224e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:13.010768 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:33:13.068691 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:13.069019 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:13.151147 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:13.152052 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:13.152935 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:13.153470 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:13.175227 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:33:13.180105 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for user 6218a0b0b4574c31a66bf6a5b0c667d4 and project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:33:13.193408 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: fa0ba140-e1f7-4eb6-ab15-a720795e4bbe] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:33:13.194662 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:13.195211 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:13.205022 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: fa0ba140-e1f7-4eb6-ab15-a720795e4bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:33:13.206777 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:13.207460 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:13.251691 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:13.252494 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-605d859d-d700-44a7-91c4-393e2cca62fb tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:28.669861 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:33:28.733426 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:28.734189 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:28.823931 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:28.824800 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:28.825912 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:28.826684 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:28.848201 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Getting quotas for project c4dff82e57264e06a648cc0ad159bb31. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:33:28.853677 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Getting quotas for user 6684da53a22d4d918c39ebbbcc5d7ff1 and project c4dff82e57264e06a648cc0ad159bb31. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:33:28.868198 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] [instance: 3c77952e-9ba9-4860-9a2e-691cb1ba29b1] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:33:28.870055 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:28.871498 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:28.892209 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] [instance: 3c77952e-9ba9-4860-9a2e-691cb1ba29b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:33:28.894284 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:28.894985 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:28.957603 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:28.958782 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31fb3336-affb-4dc0-b89d-11520b90d3f0 tempest-InstanceActionsNegativeTestJSON-684133630 tempest-InstanceActionsNegativeTestJSON-684133630-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:33.595263 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-dc8f18f0-6759-4434-8e2d-f13b13d07416 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:33:33.596531 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f18f0-6759-4434-8e2d-f13b13d07416 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:33:33.597167 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f18f0-6759-4434-8e2d-f13b13d07416 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:33:34.093219 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-dc8f18f0-6759-4434-8e2d-f13b13d07416 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Created allocations for migration 593e4d5a-8cb5-4351-88b7-e709519857d9 on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98810) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:33:34.215238 n-d-764292-25 nova-conductor[98810]: DEBUG nova.scheduler.utils [None req-dc8f18f0-6759-4434-8e2d-f13b13d07416 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] [instance: a1097a02-b9f4-4955-840e-3341f4011b93] Instance allocations successfully created on destination node 396f34e1-470a-4135-acc4-c392f4cd57ff: {'allocations': {'396f34e1-470a-4135-acc4-c392f4cd57ff': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98810) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 02:33:34.215892 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-dc8f18f0-6759-4434-8e2d-f13b13d07416 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lazy-loading 'resources' on Instance uuid a1097a02-b9f4-4955-840e-3341f4011b93 {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:33:34.221306 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-dc8f18f0-6759-4434-8e2d-f13b13d07416 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lazy-loading 'pci_requests' on Instance uuid a1097a02-b9f4-4955-840e-3341f4011b93 {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:33:34.520642 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.live_migrate [None req-dc8f18f0-6759-4434-8e2d-f13b13d07416 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] [instance: a1097a02-b9f4-4955-840e-3341f4011b93] Start binding ports on destination host: n-h1-764292-25 {{(pid=98810) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 02:34:00.739680 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:34:00.773649 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:00.774621 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:00.866016 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:00.866914 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:00.868758 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:00.873877 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:00.947539 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Getting quotas for project 158a0c2904774f658e263f360fdc3835. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:34:00.962232 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Getting quotas for user 2b1b9046ea744d588725a2f07ad4d051 and project 158a0c2904774f658e263f360fdc3835. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:34:01.000035 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] [instance: 315b1c54-0bb8-40eb-9ad6-1ff91f430cc7] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:34:01.001267 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:01.004056 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:01.019222 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] [instance: 315b1c54-0bb8-40eb-9ad6-1ff91f430cc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:34:01.020726 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:01.021402 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:01.084137 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:01.084809 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2f4fdff-3364-4edd-81a2-48e28e17dde9 tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:10.291288 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:34:10.338225 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:10.338225 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:10.463179 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:10.464145 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:10.469828 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:10.470665 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:10.509528 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Getting quotas for project 4b44336773174514aa50ac9435ef6083. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:34:10.520245 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Getting quotas for user 4451eb4e3358479282e2004ac61925ab and project 4b44336773174514aa50ac9435ef6083. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:34:10.541396 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] [instance: 5716128f-62a0-4bf3-abc7-b20773785f91] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:34:10.542660 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:10.543206 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:10.562648 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] [instance: 5716128f-62a0-4bf3-abc7-b20773785f91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:34:10.564223 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:10.564785 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:10.635345 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:10.636337 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8834cf82-31d5-4a77-a28a-16998011239e tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:13.405887 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:34:13.463032 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:13.466428 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:13.598021 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:13.598660 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:13.606447 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:13.607056 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:13.654006 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Getting quotas for project 4b44336773174514aa50ac9435ef6083. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:34:13.663504 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Getting quotas for user 4451eb4e3358479282e2004ac61925ab and project 4b44336773174514aa50ac9435ef6083. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:34:13.685552 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] [instance: 83e1422f-942b-49b6-b0c5-bc29f57e1c3c] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:34:13.687010 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:13.694433 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:13.707176 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] [instance: 83e1422f-942b-49b6-b0c5-bc29f57e1c3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:34:13.708676 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:13.709188 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:13.768372 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:13.769232 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-97a3adbe-5fba-424c-9f27-8d9fb0e9b541 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:17.139629 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:34:17.236433 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:17.236856 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:17.346448 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:17.347073 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:17.348184 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:17.348920 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:17.369578 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Getting quotas for project 4b44336773174514aa50ac9435ef6083. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:34:17.375482 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Getting quotas for user 4451eb4e3358479282e2004ac61925ab and project 4b44336773174514aa50ac9435ef6083. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:34:17.390509 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] [instance: 0a29fd0a-9f40-4120-880c-f1d643d0a696] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:34:17.391798 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:17.392389 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:17.425724 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] [instance: 0a29fd0a-9f40-4120-880c-f1d643d0a696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:34:17.427646 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:17.428066 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:17.513762 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:17.514219 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-962b6f72-b896-48a7-a5b0-5c90c7dbae55 tempest-ListServerFiltersTestJSON-878845257 tempest-ListServerFiltersTestJSON-878845257-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:17.719658 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:34:18.748569 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45520. May 28 02:34:25.396224 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:34:25.458846 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:25.459257 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:25.567987 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:25.568654 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:25.569532 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:25.570073 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:25.612888 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:34:25.617036 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for user 6218a0b0b4574c31a66bf6a5b0c667d4 and project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:34:25.644548 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: 88c6ee8c-1f49-4d7f-9fe8-9a6349ba19f0] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:34:25.645747 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:25.646333 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:25.657355 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: 88c6ee8c-1f49-4d7f-9fe8-9a6349ba19f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:34:25.658654 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:25.659083 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:25.731202 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:25.731613 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e5e4da5-3c4d-4d9b-985f-dee157d5cbc3 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:32.506491 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:34:37.470492 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:34:37.516935 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:37.517627 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:37.605959 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:37.606934 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:37.607548 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:37.607945 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:37.667299 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:34:37.674684 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for user 6218a0b0b4574c31a66bf6a5b0c667d4 and project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:34:37.703660 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: 28254af4-b276-4225-a156-9915a3df6b1c] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:34:37.704641 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:37.705053 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:37.726098 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: 28254af4-b276-4225-a156-9915a3df6b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:34:37.727627 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:37.728038 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:37.806494 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:37.807729 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fc3247d3-5cd4-4d5e-9666-8307de7fb3b0 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:45.255381 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-45f4a764-3e98-45cf-a981-97845ff26bae tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:34:45.256555 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45f4a764-3e98-45cf-a981-97845ff26bae tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:45.258190 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45f4a764-3e98-45cf-a981-97845ff26bae tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:45.925277 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-45f4a764-3e98-45cf-a981-97845ff26bae tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Created allocations for migration 346b7658-ab2c-4bd7-825a-11de4e0ed39d on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:34:46.092931 n-d-764292-25 nova-conductor[98809]: DEBUG nova.scheduler.utils [None req-45f4a764-3e98-45cf-a981-97845ff26bae tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] [instance: 315b1c54-0bb8-40eb-9ad6-1ff91f430cc7] Instance allocations successfully created on destination node 396f34e1-470a-4135-acc4-c392f4cd57ff: {'allocations': {'396f34e1-470a-4135-acc4-c392f4cd57ff': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=98809) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 02:34:46.093610 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance [None req-45f4a764-3e98-45cf-a981-97845ff26bae tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lazy-loading 'resources' on Instance uuid 315b1c54-0bb8-40eb-9ad6-1ff91f430cc7 {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:34:46.099135 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance [None req-45f4a764-3e98-45cf-a981-97845ff26bae tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lazy-loading 'pci_requests' on Instance uuid 315b1c54-0bb8-40eb-9ad6-1ff91f430cc7 {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:34:46.875457 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.live_migrate [None req-45f4a764-3e98-45cf-a981-97845ff26bae tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] [instance: 315b1c54-0bb8-40eb-9ad6-1ff91f430cc7] Start binding ports on destination host: n-h1-764292-25 {{(pid=98809) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 02:34:54.859041 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:34:54.899897 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:54.901134 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:55.007232 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:55.007656 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:55.013887 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:55.014884 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:55.056167 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Getting quotas for project a659d707c8fa47f994426692f3e37502. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:34:55.070827 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Getting quotas for user 7c3b1636e27e40f19e758fbbf61e789a and project a659d707c8fa47f994426692f3e37502. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:34:55.094184 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] [instance: 774a6ba1-487c-433c-8019-a822b16a5799] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:34:55.095733 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:55.096288 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:55.113625 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] [instance: 774a6ba1-487c-433c-8019-a822b16a5799] block_device_mapping [BlockDeviceMapping(attachment_id=86fd833e-6eeb-4f82-a523-1efabcf2d693,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='978a20aa-5180-46ec-8f17-aa5015ea9037',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=871e6d7e-0efb-42ee-a1cd-3cd76876a847,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='745f8e7e-64a8-4065-8a20-9e56d97042fd',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=85344d6a-f013-44d5-9940-05096f46d436,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a226fc6-701b-4263-a341-39cd476baa46',volume_size=1,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:34:55.125349 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:55.126111 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:55.145175 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:55.145581 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:55.174536 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:55.174942 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:34:55.247296 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:34:55.247712 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-489ba76d-14af-4226-b33a-110dc25bdb8c tempest-TaggedBootDevicesTest_v242-24889374 tempest-TaggedBootDevicesTest_v242-24889374-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:10.982700 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:35:11.016362 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:11.017469 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:11.084495 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:11.085420 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:11.086776 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:11.087484 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:11.109888 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:35:11.114661 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for user 6218a0b0b4574c31a66bf6a5b0c667d4 and project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:35:11.132988 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: 9a335cc3-7f2a-4c84-8230-6c1f6f29409d] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:35:11.140066 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:11.140676 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:11.168265 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: 9a335cc3-7f2a-4c84-8230-6c1f6f29409d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:35:11.170074 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:11.170825 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:11.220207 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:11.220626 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d5d323ef-a6ec-4c23-b94b-d8408fb2d2f6 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:15.113779 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:35:15.296827 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:35:15.329529 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:15.329982 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:15.416539 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:15.416945 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:15.418328 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:15.419008 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:15.436972 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Getting quotas for project 66415e6968ac443a896f73dd9cf99a05. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:35:15.442383 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Getting quotas for user 6a89c5ebe1734610a6dcec48b8a6c7ba and project 66415e6968ac443a896f73dd9cf99a05. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:35:15.454966 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] [instance: 477b4287-ef73-4ddb-b723-2e00b9d5fc66] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:35:15.456206 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:15.456799 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:15.467934 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] [instance: 477b4287-ef73-4ddb-b723-2e00b9d5fc66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:35:15.470568 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:15.471297 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:15.561155 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:15.562105 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1820f5fe-8089-4fd5-8c32-406cc1afb1bc tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:41.817376 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:35:41.851611 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:41.852501 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:41.922278 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:41.922903 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:41.923859 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:41.924900 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:41.951761 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Getting quotas for project bd4dad9d5d99427cab51b63a9feb836b. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:35:41.957441 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Getting quotas for user fbb65365fc774ba398b841d4ed1cfa5c and project bd4dad9d5d99427cab51b63a9feb836b. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:35:41.968000 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] [instance: 48c35b00-72f7-45fc-a2f4-a9a43c22df08] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:35:41.969181 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:41.969996 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:41.988837 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] [instance: 48c35b00-72f7-45fc-a2f4-a9a43c22df08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:35:41.990525 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:41.991135 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:35:42.047432 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:35:42.047865 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-32108a2f-564b-425c-8f4c-70f48bd0b6c5 tempest-ServerRescueTestJSONUnderV235-1799349258 tempest-ServerRescueTestJSONUnderV235-1799349258-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:06.405160 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:36:06.432889 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:06.433363 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:06.492548 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:06.493277 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:06.494555 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:06.495136 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:06.514039 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Getting quotas for project 158a0c2904774f658e263f360fdc3835. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:36:06.518504 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Getting quotas for user 2b1b9046ea744d588725a2f07ad4d051 and project 158a0c2904774f658e263f360fdc3835. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:36:06.530426 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] [instance: 726e665d-b770-46da-aecd-732e9d442b45] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:36:06.531999 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:06.532587 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:06.545866 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] [instance: 726e665d-b770-46da-aecd-732e9d442b45] block_device_mapping [BlockDeviceMapping(attachment_id=e477be5c-62fe-48a2-bfb5-9175472cfc99,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dba4baa2-68a5-40a4-9d34-96428e750e8b',volume_size=1,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:36:06.547637 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:06.548247 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:06.612209 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:06.612781 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-60e94c17-fa4b-49db-ad52-53a1b6f6bf8e tempest-LiveAutoBlockMigrationV225Test-1184628584 tempest-LiveAutoBlockMigrationV225Test-1184628584-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:29.310460 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Took 0.60 seconds to select destinations for 2 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:36:29.371706 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:29.372446 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:29.511660 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:29.514506 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:29.633079 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:29.637767 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:29.638864 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:29.639577 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:29.676325 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Getting quotas for project a5fb0198314a48829ba7fa1015559325. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:36:29.684534 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Getting quotas for user 656d1b0fa4e449599b1db993027ad2c8 and project a5fb0198314a48829ba7fa1015559325. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:36:29.706655 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] [instance: 4b2de47d-3c04-4bcd-8493-21f32cde2028] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:36:29.707748 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:29.711700 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:29.722510 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] [instance: 4b2de47d-3c04-4bcd-8493-21f32cde2028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:36:29.724245 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:29.724977 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:29.792650 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:29.793514 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:29.807745 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] [instance: 0f3c0d1a-dce4-48e0-8eba-bc0bd4b1bb95] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:36:29.811623 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:29.812431 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:29.831880 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] [instance: 0f3c0d1a-dce4-48e0-8eba-bc0bd4b1bb95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:36:29.836251 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:29.837599 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:29.914420 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:29.915037 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5f06c25c-6b43-4315-aabe-037c663a430c tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:32.716272 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:36:33.747825 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 47606. May 28 02:36:39.945650 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1cee7fdc-9568-4797-a579-dccbd26b10e5 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:36:39.949370 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1cee7fdc-9568-4797-a579-dccbd26b10e5 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:39.950461 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1cee7fdc-9568-4797-a579-dccbd26b10e5 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:40.462933 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-1cee7fdc-9568-4797-a579-dccbd26b10e5 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Created allocations for migration c64b1057-3901-449b-9d1d-3e19c9b26cf2 on 396f34e1-470a-4135-acc4-c392f4cd57ff {{(pid=98810) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:36:40.591783 n-d-764292-25 nova-conductor[98810]: DEBUG nova.scheduler.utils [None req-1cee7fdc-9568-4797-a579-dccbd26b10e5 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] [instance: 726e665d-b770-46da-aecd-732e9d442b45] Instance allocations successfully created on destination node 1bff8e46-e9c8-450f-8078-657cbe80b915: {'allocations': {'1bff8e46-e9c8-450f-8078-657cbe80b915': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=98810) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 28 02:36:40.592474 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-1cee7fdc-9568-4797-a579-dccbd26b10e5 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lazy-loading 'resources' on Instance uuid 726e665d-b770-46da-aecd-732e9d442b45 {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:36:40.597316 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-1cee7fdc-9568-4797-a579-dccbd26b10e5 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] Lazy-loading 'pci_requests' on Instance uuid 726e665d-b770-46da-aecd-732e9d442b45 {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:36:40.905661 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.live_migrate [None req-1cee7fdc-9568-4797-a579-dccbd26b10e5 tempest-LiveAutoBlockMigrationV225Test-1206343354 tempest-LiveAutoBlockMigrationV225Test-1206343354-project-admin] [instance: 726e665d-b770-46da-aecd-732e9d442b45] Start binding ports on destination host: n-h2-764292-25 {{(pid=98810) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 02:36:53.247265 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:36:53.272589 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:53.272994 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:53.324450 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:53.324928 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:53.325759 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:53.326498 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:53.344126 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:36:53.349304 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for user 6218a0b0b4574c31a66bf6a5b0c667d4 and project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:36:53.362908 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: 0038a549-5dd0-409e-972b-14e47af8b981] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:36:53.364223 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:53.364844 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:53.372612 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: 0038a549-5dd0-409e-972b-14e47af8b981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:36:53.374154 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:53.374705 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:36:53.415761 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:36:53.416329 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-e498b074-70dd-4e9c-b083-8ec70f18df8a tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:05.104701 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Took 0.56 seconds to select destinations for 2 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:37:05.143610 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:05.147534 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:05.231354 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:05.231769 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:05.283420 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:05.286907 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:05.291228 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:05.291755 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:05.332129 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Getting quotas for project a5fb0198314a48829ba7fa1015559325. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:37:05.340140 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Getting quotas for user 656d1b0fa4e449599b1db993027ad2c8 and project a5fb0198314a48829ba7fa1015559325. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:37:05.352710 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] [instance: 3e39ad27-2b15-47de-91e5-c5b7b58f1d86] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:37:05.353728 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:05.354142 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:05.366620 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] [instance: 3e39ad27-2b15-47de-91e5-c5b7b58f1d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:37:05.370788 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:05.371210 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:05.441207 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:05.441951 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:05.455499 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] [instance: 64724dfe-7ade-444f-aea1-fe6882c1f895] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:37:05.459475 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:05.460331 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:05.479230 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] [instance: 64724dfe-7ade-444f-aea1-fe6882c1f895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:37:05.481156 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:05.482047 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:05.557023 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:05.557650 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-daaa7971-7f56-40d1-8e91-eb3d6d40ad3b tempest-MultipleCreateTestJSON-299166401 tempest-MultipleCreateTestJSON-299166401-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:18.748586 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:37:19.775160 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 48170. May 28 02:37:26.428911 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:37:26.484429 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:26.484838 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:26.557060 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:26.557474 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:26.558208 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:26.558758 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:26.597177 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Getting quotas for project dce6edc70da643aca3f27267859a03dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:37:26.609561 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Getting quotas for user 827c169907994a38a805b8f0a36a816f and project dce6edc70da643aca3f27267859a03dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:37:26.634542 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] [instance: 4946eb49-42ed-4dc0-a9ae-957f1b962dad] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:37:26.635981 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:26.636383 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:26.646583 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] [instance: 4946eb49-42ed-4dc0-a9ae-957f1b962dad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:37:26.647963 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:26.649549 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:26.736024 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:26.736456 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0a6b7941-6143-4780-ba4c-5082658cf21a tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:28.096273 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:37:28.155461 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:28.155869 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:28.259965 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:28.262849 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:28.263776 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:28.266626 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:28.306709 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Getting quotas for project dce6edc70da643aca3f27267859a03dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:37:28.331146 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Getting quotas for user 827c169907994a38a805b8f0a36a816f and project dce6edc70da643aca3f27267859a03dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:37:28.351315 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] [instance: add6bd6e-5bd7-40b4-95c7-2588962046a3] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:37:28.352428 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:28.352830 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:28.368937 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] [instance: add6bd6e-5bd7-40b4-95c7-2588962046a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:37:28.371455 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:28.373254 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:28.436749 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:28.437156 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-49482357-69ba-4208-9456-92e56792a5c4 tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:36.361068 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-3adc6f9f-b1bd-40b8-a2ed-b807f975f50c tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method rebuild_instance {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:37:36.364769 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3adc6f9f-b1bd-40b8-a2ed-b807f975f50c tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:36.365193 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3adc6f9f-b1bd-40b8-a2ed-b807f975f50c tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:36.387676 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-3adc6f9f-b1bd-40b8-a2ed-b807f975f50c tempest-ServerShowV247Test-427694865 tempest-ServerShowV247Test-427694865-project] [instance: add6bd6e-5bd7-40b4-95c7-2588962046a3] No migration record for the rebuild/evacuate request. {{(pid=98809) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 02:37:41.338887 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:37:41.368575 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:41.369549 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:41.484979 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:41.485565 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:41.486519 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:41.486925 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:41.504894 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Getting quotas for project 9843cb0314fc4446b553ff905f2849f5. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:37:41.509500 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Getting quotas for user 3d69157a90f44dfbab8ecd0c1213cb35 and project 9843cb0314fc4446b553ff905f2849f5. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:37:41.519980 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] [instance: 499cf9bd-cb72-40eb-a8bb-1b7f7c811032] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:37:41.521660 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:41.522880 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:41.538985 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] [instance: 499cf9bd-cb72-40eb-a8bb-1b7f7c811032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:37:41.551740 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:41.552160 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:41.613365 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:41.613779 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0ef48dd-2e7e-45ec-ab77-b8b87f98b17c tempest-AttachVolumeTestJSON-701259369 tempest-AttachVolumeTestJSON-701259369-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:49.981603 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:37:50.007113 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:50.008320 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:50.080898 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:50.081729 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:50.082960 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:50.083567 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:50.107515 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Getting quotas for project 2c8ad9bb5de341c98a06666fc6543adb. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:37:50.111914 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Getting quotas for user 09cb40e7697249e7815c1126b6de20fc and project 2c8ad9bb5de341c98a06666fc6543adb. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:37:50.123961 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] [instance: 7b3d9b8f-7e0c-4019-ac01-e93b87725dc0] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:37:50.125279 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:50.126394 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:50.135174 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] [instance: 7b3d9b8f-7e0c-4019-ac01-e93b87725dc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:37:50.137371 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:50.138069 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:50.182533 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:50.183336 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-dca73741-fe54-4d91-831d-cddb5868390b tempest-ServerAddressesTestJSON-1943736746 tempest-ServerAddressesTestJSON-1943736746-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:51.370311 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:37:51.423531 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:51.424285 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:51.555799 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:51.556225 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:51.557643 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:51.559040 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:51.604494 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:37:51.609774 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Getting quotas for user 6218a0b0b4574c31a66bf6a5b0c667d4 and project 49ca676c6322428892ae2d18fef8d0c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:37:51.621327 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: 3cd6c327-ea45-4ff0-9bbb-73b641a88d4b] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:37:51.622495 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:51.622898 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:51.632010 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] [instance: 3cd6c327-ea45-4ff0-9bbb-73b641a88d4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:37:51.633999 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:51.634645 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:51.673747 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:37:51.674229 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-31a159e6-0172-4ab8-a52f-4f24d5d451f4 tempest-DeleteServersTestJSON-1591965413 tempest-DeleteServersTestJSON-1591965413-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:37:52.536642 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:38:24.978196 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:38:25.031649 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:25.032246 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:25.132413 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:25.134331 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:25.135524 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:25.135936 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:25.156452 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Getting quotas for project 63e47b69f0cd4285878c9bbc4865e044. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:38:25.163755 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Getting quotas for user 100daa53761a4770be2db336a0911531 and project 63e47b69f0cd4285878c9bbc4865e044. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:38:25.178453 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] [instance: 403cf3d6-5dab-4252-be6d-fca829dcbf65] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:38:25.184183 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:25.184618 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:25.203087 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] [instance: 403cf3d6-5dab-4252-be6d-fca829dcbf65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:38:25.204584 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:25.205170 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:25.250450 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:25.250967 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bec847ce-1557-499b-a127-0f9aec1eef3d tempest-ServerMetadataNegativeTestJSON-1832148512 tempest-ServerMetadataNegativeTestJSON-1832148512-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:27.401510 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:38:27.434815 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:27.435500 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:27.554487 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:27.555114 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:27.556316 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:27.557170 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:27.601341 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:38:27.617418 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for user 7cc349b947734f5d9812af5ed31c2f43 and project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:38:27.645755 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: 6580e92d-8456-4449-9bbb-6ee248c149cd] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:38:27.649033 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:27.650398 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:27.666537 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: 6580e92d-8456-4449-9bbb-6ee248c149cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:38:27.668135 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:27.668640 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:27.733088 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:27.733503 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-acb6d671-46b1-4b3d-b9a9-22a28c9a123f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:52.960056 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:38:53.003734 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:53.007011 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:53.149087 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:53.149483 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:53.150466 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:53.151182 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:53.222962 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Getting quotas for project e473c9b680bf402e8afac299de025b46. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:38:53.234965 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Getting quotas for user 1a4dcf5f9e7943179a996adfc90d050e and project e473c9b680bf402e8afac299de025b46. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:38:53.257503 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] [instance: c463074c-0d13-464f-88b9-dbad9569cb24] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:38:53.260377 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:53.261982 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:53.281183 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] [instance: c463074c-0d13-464f-88b9-dbad9569cb24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:38:53.283005 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:53.283945 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:53.354816 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:53.355606 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-34577969-b864-4e3e-9f74-c09bbfe97877 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:55.888260 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:38:55.939380 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:55.942920 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:56.042638 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:56.042638 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:56.042638 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:56.042638 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:56.079584 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Getting quotas for project e473c9b680bf402e8afac299de025b46. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:38:56.085710 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Getting quotas for user 1a4dcf5f9e7943179a996adfc90d050e and project e473c9b680bf402e8afac299de025b46. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:38:56.109109 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] [instance: c61c65d2-9028-401e-8848-84dd6a93d5c4] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:38:56.110266 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:56.110939 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:56.121509 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] [instance: c61c65d2-9028-401e-8848-84dd6a93d5c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:38:56.124466 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:56.125110 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:56.194757 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:38:56.195341 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9877b772-21a4-40bf-8bd8-49c130c2b230 tempest-ServerRescueNegativeTestJSON-1429647740 tempest-ServerRescueNegativeTestJSON-1429647740-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:38:59.637032 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-43c83636-cf17-4a17-a8ac-2c659d1a139e tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:38:59.681138 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-43c83636-cf17-4a17-a8ac-2c659d1a139e tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: 49c0df25-96db-45cd-a41a-601a954b7778] While scheduling instance, the build request was already deleted. {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1572}} May 28 02:39:00.104069 n-d-764292-25 nova-conductor[98809]: INFO nova.scheduler.client.report [None req-43c83636-cf17-4a17-a8ac-2c659d1a139e tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Deleted allocation for instance 49c0df25-96db-45cd-a41a-601a954b7778 May 28 02:39:00.113340 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-43c83636-cf17-4a17-a8ac-2c659d1a139e tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:00.114831 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-43c83636-cf17-4a17-a8ac-2c659d1a139e tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:00.119118 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-43c83636-cf17-4a17-a8ac-2c659d1a139e tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:00.122354 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-43c83636-cf17-4a17-a8ac-2c659d1a139e tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:00.197708 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-43c83636-cf17-4a17-a8ac-2c659d1a139e tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:39:00.212498 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-43c83636-cf17-4a17-a8ac-2c659d1a139e tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for user 7cc349b947734f5d9812af5ed31c2f43 and project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:39:04.019728 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:39:04.122955 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:04.123375 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:04.220427 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:04.220993 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:04.221924 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:04.222432 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:04.250086 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:39:04.255529 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for user 7cc349b947734f5d9812af5ed31c2f43 and project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:39:04.268241 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: 193687b5-8f9f-4feb-8cbd-ea1dcc4d2834] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:39:04.269822 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:04.270224 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:04.283463 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: 193687b5-8f9f-4feb-8cbd-ea1dcc4d2834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:39:04.284993 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:04.285472 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:04.363109 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:04.363528 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d46295bd-b138-43c4-a42e-afbe7b8ac5aa tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:17.709995 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:39:17.740275 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:17.741213 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:17.834923 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:17.835651 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:17.836769 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:17.837646 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:17.856992 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Getting quotas for project fbe261b5d65745979d6c631d62fc798c. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:39:17.863085 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Getting quotas for user 80e0bc24e5e6462d87664fa08ff2bbb5 and project fbe261b5d65745979d6c631d62fc798c. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:39:17.881068 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] [instance: bac023f4-0055-4f82-b30b-180d76ef53c1] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:39:17.882906 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:17.884368 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:17.899259 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] [instance: bac023f4-0055-4f82-b30b-180d76ef53c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:39:17.901476 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:17.902205 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:17.951434 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:17.951874 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f40c0d8-e743-46d2-b182-ca4906567e75 tempest-ServerPasswordTestJSON-46792675 tempest-ServerPasswordTestJSON-46792675-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:33.744987 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:39:34.774917 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 51438. May 28 02:39:35.719265 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:39:35.767699 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:35.768186 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:35.833501 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:35.834625 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:35.835534 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:35.836119 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:35.856287 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:39:35.861351 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for user 7cc349b947734f5d9812af5ed31c2f43 and project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:39:35.874404 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: 345b7716-18b3-4ea6-ac5c-85cf94735879] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:39:35.876070 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:35.876714 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:35.891092 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: 345b7716-18b3-4ea6-ac5c-85cf94735879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:39:35.892915 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:35.893831 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:39:35.952478 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:39:35.952950 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-981ee17c-072f-4632-ab0e-39314e1fc28c tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:09.535036 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:40:09.587194 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:09.587603 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:09.667448 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:09.668243 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:09.669271 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:09.669950 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:09.704751 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:40:09.711806 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for user 7cc349b947734f5d9812af5ed31c2f43 and project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:40:09.727964 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: baad06a9-5c00-4ff1-81c7-9507786ed525] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:40:09.729272 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:09.729882 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:09.752826 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: baad06a9-5c00-4ff1-81c7-9507786ed525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:40:09.754894 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:09.758597 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:09.842305 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:09.842720 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0f97ac59-0107-4364-9570-abf9a38c22e2 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:15.138666 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:40:15.411009 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:40:15.443795 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:15.444203 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:15.560702 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:15.561111 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:15.561869 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:15.562288 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:15.584030 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Getting quotas for project 7e3823cae2c041a98120ba851d111f47. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:40:15.589781 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Getting quotas for user 7f9e55b7d3674a2eafa229ede5baa4e6 and project 7e3823cae2c041a98120ba851d111f47. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:40:15.603602 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] [instance: 048e45c2-7949-45d6-944a-9cec33e3a390] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:40:15.604817 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:15.605377 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:15.622920 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] [instance: 048e45c2-7949-45d6-944a-9cec33e3a390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:40:15.624506 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:15.624820 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:15.696767 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:15.697430 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-fb210546-0ec0-4711-899b-23f467e459d7 tempest-ServersTestJSON-1954489742 tempest-ServersTestJSON-1954489742-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:19.775285 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:40:20.802084 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 52756. May 28 02:40:30.180693 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:40:30.214642 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:30.214898 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:30.276818 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:30.277443 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:30.278365 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:30.278962 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:30.299308 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Getting quotas for project 66415e6968ac443a896f73dd9cf99a05. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:40:30.305783 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Getting quotas for user 6a89c5ebe1734610a6dcec48b8a6c7ba and project 66415e6968ac443a896f73dd9cf99a05. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:40:30.322199 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] [instance: c37348e0-6ac0-4b7f-a2db-ef5ada7d3d3f] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:40:30.323747 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:30.324343 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:30.348370 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] [instance: c37348e0-6ac0-4b7f-a2db-ef5ada7d3d3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:40:30.350308 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:30.350722 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:30.419563 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:30.419974 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9df3f380-142f-4123-b936-71c5b42b737c tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:32.246358 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:40:32.329886 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:32.333293 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:32.408566 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:32.408991 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:32.409727 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:32.410125 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:32.427090 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:40:32.432201 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for user 7cc349b947734f5d9812af5ed31c2f43 and project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:40:32.444454 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: b12ad50c-b3ab-455f-b10b-15f4bb664dc4] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:40:32.445327 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:32.445774 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:32.452954 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: b12ad50c-b3ab-455f-b10b-15f4bb664dc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:40:32.454429 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:32.454834 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:40:32.492907 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:40:32.493532 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ce8f935d-aabc-4e4b-8cba-d330c13978be tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:09.829714 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:41:09.864893 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:09.865576 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:09.966866 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:09.967597 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:09.968525 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:09.969122 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:09.991711 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:41:09.997046 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for user 7cc349b947734f5d9812af5ed31c2f43 and project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:41:10.010512 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: a96d3f71-8604-4dd2-ae97-11308343c8ff] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:41:10.014000 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:10.014000 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:10.023672 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: a96d3f71-8604-4dd2-ae97-11308343c8ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:41:10.025702 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:10.026432 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:10.076374 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:10.076842 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2c0fb462-6c34-4fe5-b4c5-e3c2e3ea40d8 tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:12.568389 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:41:26.379939 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:41:26.435122 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:26.435656 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:26.514745 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:26.516218 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:26.517128 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:26.518168 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:26.547336 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Getting quotas for project 66415e6968ac443a896f73dd9cf99a05. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:41:26.555550 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Getting quotas for user 6a89c5ebe1734610a6dcec48b8a6c7ba and project 66415e6968ac443a896f73dd9cf99a05. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:41:26.573793 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] [instance: cd7d481b-0626-41b4-925e-f2fff534ebf1] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:41:26.576225 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:26.576837 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:26.599841 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] [instance: cd7d481b-0626-41b4-925e-f2fff534ebf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:41:26.601336 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:26.601843 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:26.654836 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:26.655410 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-48230e72-1567-455f-9a24-3ff88ed1b7f2 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:36.865613 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:41:36.917025 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:36.917681 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:37.025619 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:37.026440 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:37.028815 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:37.029284 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:37.053819 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:41:37.059506 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Getting quotas for user 7cc349b947734f5d9812af5ed31c2f43 and project 25c9c7c87b6642cc8daaa3bd3d9c63af. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:41:37.074183 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: 93c5f521-49a6-4faf-a08d-1708d2e3e2a0] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:41:37.086808 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:37.087698 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:37.098950 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] [instance: 93c5f521-49a6-4faf-a08d-1708d2e3e2a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:41:37.103874 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:37.104715 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:41:37.172856 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:41:37.173329 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-911d3680-3356-4be5-bd52-3315cce6c89f tempest-ServersTestJSON-201479865 tempest-ServersTestJSON-201479865-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:42:30.223937 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Took 1.12 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:42:30.285582 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:42:30.286088 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:42:30.371091 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:42:30.371935 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:42:30.372873 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:42:30.374489 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:42:30.393243 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Getting quotas for project ce27c33e2d324d62a0d6ffb0b9d6430d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:42:30.398619 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Getting quotas for user 635679da3d5143a1a42199a12046cf63 and project ce27c33e2d324d62a0d6ffb0b9d6430d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:42:30.433653 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] [instance: 94f99503-21ec-4d91-863a-9e7509c587c3] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:42:30.443361 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:42:30.443898 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:42:30.465571 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] [instance: 94f99503-21ec-4d91-863a-9e7509c587c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:42:30.466853 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:42:30.467268 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:42:30.528513 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:42:30.529214 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c02d56c3-a791-4651-be58-c903034cbf45 tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:42:34.771539 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:42:35.797952 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 56258. May 28 02:43:03.115844 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:43:03.139079 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:03.139941 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:03.212612 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:03.213160 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:03.214112 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:03.214588 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:03.232459 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Getting quotas for project ce27c33e2d324d62a0d6ffb0b9d6430d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:43:03.238587 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Getting quotas for user 635679da3d5143a1a42199a12046cf63 and project ce27c33e2d324d62a0d6ffb0b9d6430d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:43:03.251161 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] [instance: 4293b524-a11f-40e7-acd2-907a8bb58999] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:43:03.252103 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:03.252508 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:03.263478 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] [instance: 4293b524-a11f-40e7-acd2-907a8bb58999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:43:03.264645 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:03.265065 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:03.302088 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:03.303362 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-bdf4ef67-f770-4f3b-914c-7b07dce83e5a tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:20.804267 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:43:21.835374 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 58284. May 28 02:43:30.900125 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:43:30.954095 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:30.956844 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:31.057637 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:31.058046 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:31.058799 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:31.059190 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:31.105764 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Getting quotas for project ce27c33e2d324d62a0d6ffb0b9d6430d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:43:31.110805 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Getting quotas for user 635679da3d5143a1a42199a12046cf63 and project ce27c33e2d324d62a0d6ffb0b9d6430d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:43:31.127957 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] [instance: 5afab7e9-bcc7-4f3c-a4a2-d82f09486c62] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:43:31.128919 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:31.129325 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:31.139403 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] [instance: 5afab7e9-bcc7-4f3c-a4a2-d82f09486c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:43:31.141027 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:31.141658 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:31.204874 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:31.205218 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-753341fb-4541-46d1-9d6d-023c67a19a2b tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:35.163540 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:43:58.856035 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:43:58.901978 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:58.903047 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:59.052768 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:59.055486 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:59.056437 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:59.058306 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:59.095290 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Getting quotas for project 0d5856f0b7e44bf7a205c0d11cf420b1. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:43:59.119480 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Getting quotas for user 7137e18ea82249bd964b30093e6bd2e0 and project 0d5856f0b7e44bf7a205c0d11cf420b1. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:43:59.160557 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] [instance: 8907cd8c-d46b-4899-b8a3-bc444fa73d57] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:43:59.161663 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:59.164321 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:59.185921 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] [instance: 8907cd8c-d46b-4899-b8a3-bc444fa73d57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:43:59.187678 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:59.188256 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:43:59.269988 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:43:59.271686 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fd4ef46f-9fdb-4774-831b-291ddd8f1013 tempest-InstanceActionsV221TestJSON-763260328 tempest-InstanceActionsV221TestJSON-763260328-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:20.972914 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:44:21.001218 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:21.001991 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:21.075607 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:21.076574 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:21.077606 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:21.078231 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:21.098254 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Getting quotas for project 01964dd1d0be40a6976efa076051b58d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:44:21.103903 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Getting quotas for user d26c56b6df0d4d49bc163a3e1a9d242f and project 01964dd1d0be40a6976efa076051b58d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:44:21.119435 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] [instance: 55c5601c-5b00-40ae-9acf-f568bb407c46] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:44:21.120620 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:21.121481 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:21.131250 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] [instance: 55c5601c-5b00-40ae-9acf-f568bb407c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:44:21.133657 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:21.134392 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:21.176955 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:21.177980 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4f636601-3540-4c5f-9aec-bc4189ec86d4 tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:25.074473 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:44:25.120064 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:25.121494 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:25.206384 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:25.209660 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:25.210682 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:25.211207 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:25.230307 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Getting quotas for project ce27c33e2d324d62a0d6ffb0b9d6430d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:44:25.235399 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Getting quotas for user 635679da3d5143a1a42199a12046cf63 and project ce27c33e2d324d62a0d6ffb0b9d6430d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:44:25.248431 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] [instance: 564114e1-97e9-4a6f-b0ac-61fe42afcd08] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:44:25.249529 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:25.250191 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:25.260762 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] [instance: 564114e1-97e9-4a6f-b0ac-61fe42afcd08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:44:25.262412 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:25.263025 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:25.338967 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:25.339277 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-27f8a2b0-a9a3-4e3a-9e37-9690c8ca842f tempest-AttachVolumeNegativeTest-704194341 tempest-AttachVolumeNegativeTest-704194341-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:32.596206 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:44:35.368358 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:44:35.432874 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:35.433551 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:35.490932 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:35.491534 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:35.492522 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:35.493060 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:35.528497 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Getting quotas for project 66415e6968ac443a896f73dd9cf99a05. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:44:35.534561 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Getting quotas for user 6a89c5ebe1734610a6dcec48b8a6c7ba and project 66415e6968ac443a896f73dd9cf99a05. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:44:35.546960 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] [instance: 7215bfdf-4b97-4819-889f-46a4632f5d13] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:44:35.548286 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:35.549418 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:35.561517 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] [instance: 7215bfdf-4b97-4819-889f-46a4632f5d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:44:35.562793 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:35.563188 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:35.605949 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:35.606874 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3cd94d06-89b3-41fc-b2c7-fa4413ed4d99 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.225649 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Took 0.56 seconds to select destinations for 3 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:44:40.257601 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.258012 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.333119 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.334073 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.398190 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.398647 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.448127 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.448825 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.449872 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.450665 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.468103 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Getting quotas for project 1af33c4b29ed401490c2c278e9d79343. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:44:40.474402 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Getting quotas for user 98525562eb80490b8dbcac02ad984739 and project 1af33c4b29ed401490c2c278e9d79343. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:44:40.486845 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] [instance: d9a31f88-5728-4118-bf43-fd2a6eeefc31] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:44:40.488091 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.488665 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.500055 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] [instance: d9a31f88-5728-4118-bf43-fd2a6eeefc31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:44:40.501698 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.502111 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.542429 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.543084 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.554363 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] [instance: 57d293f3-098b-4336-b4b2-66b473232a9f] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:44:40.555880 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.556357 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.565346 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] [instance: 57d293f3-098b-4336-b4b2-66b473232a9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:44:40.567281 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.568071 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.613887 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.614946 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.636971 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] [instance: a28efb90-f5fd-44df-8d4b-f4687579ce86] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:44:40.642779 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.643282 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.663092 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] [instance: a28efb90-f5fd-44df-8d4b-f4687579ce86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:44:40.664794 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.665612 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:40.738364 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:40.739276 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d2d706c3-681a-43e7-b39d-849717e2208a tempest-ListServersNegativeTestJSON-1306496693 tempest-ListServersNegativeTestJSON-1306496693-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:57.838811 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:44:57.885394 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:57.886210 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:58.004706 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:58.005080 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:58.007365 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:58.007808 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:58.035236 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Getting quotas for project 01964dd1d0be40a6976efa076051b58d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:44:58.040335 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Getting quotas for user d26c56b6df0d4d49bc163a3e1a9d242f and project 01964dd1d0be40a6976efa076051b58d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:44:58.051995 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] [instance: ae822fb7-27c4-4504-a80a-48cd95c6fec6] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:44:58.053223 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:58.053751 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:58.061788 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] [instance: ae822fb7-27c4-4504-a80a-48cd95c6fec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:44:58.063493 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:58.064298 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:44:58.128544 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:44:58.128943 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99d5b81d-3e97-4c9e-b304-a2a1bac2d45e tempest-VolumesActionsTest-1712213340 tempest-VolumesActionsTest-1712213340-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:45:11.983653 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:45:12.033498 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:45:12.034167 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:45:12.144173 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:45:12.145622 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:45:12.148873 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:45:12.149719 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:45:12.213878 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Getting quotas for project 66415e6968ac443a896f73dd9cf99a05. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:45:12.229382 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Getting quotas for user 6a89c5ebe1734610a6dcec48b8a6c7ba and project 66415e6968ac443a896f73dd9cf99a05. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:45:12.327913 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] [instance: 77a02059-1608-49b0-9f58-010f665e8851] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:45:12.331275 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:45:12.337954 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:45:12.350545 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] [instance: 77a02059-1608-49b0-9f58-010f665e8851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:45:12.351805 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:45:12.352245 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:45:12.426270 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:45:12.426745 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2bc2c6a3-e66a-4fa0-bb7d-7aa83135cce5 tempest-ServerActionsTestJSON-1687110769 tempest-ServerActionsTestJSON-1687110769-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:45:35.800628 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:45:36.827105 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 34330. May 28 02:46:13.359179 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:46:13.457978 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:13.473537 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:13.694720 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:13.695214 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:13.696016 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:13.696414 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:13.778055 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Getting quotas for project ce4166726cc04368bcb8ca3761f0b8c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:46:13.813382 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Getting quotas for user 7e864763a2eb46bab54d04840238ae59 and project ce4166726cc04368bcb8ca3761f0b8c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:46:13.854872 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] [instance: d1438204-9351-44e8-a502-0609d7f0a901] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:46:13.855850 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:13.856254 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:13.881793 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] [instance: d1438204-9351-44e8-a502-0609d7f0a901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:46:13.884388 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:13.885038 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:14.025011 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:14.025422 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-21106b9f-0fb4-4b90-aa74-2357cc423633 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:21.836688 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 02:46:22.861469 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 35266. May 28 02:46:37.988585 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:46:38.041395 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:38.041720 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:38.164932 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:38.165346 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:38.168350 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:38.168759 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:38.241028 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Getting quotas for project ce4166726cc04368bcb8ca3761f0b8c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:46:38.258696 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Getting quotas for user 7e864763a2eb46bab54d04840238ae59 and project ce4166726cc04368bcb8ca3761f0b8c3. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:46:38.313263 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] [instance: f5ad8361-ff6b-445d-9e7f-99a4a706901a] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:46:38.317176 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:38.319324 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:38.339304 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] [instance: f5ad8361-ff6b-445d-9e7f-99a4a706901a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:46:38.342337 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:38.343293 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:38.412398 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:38.413079 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ec981e10-134b-4cbd-a10f-761dbbc11eb6 tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:53.614486 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:46:53.653786 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:53.657449 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:53.755365 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:53.756490 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:53.757782 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:53.758488 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:53.776529 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Getting quotas for project 805d142a25a246379bd17aadd8173851. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:46:53.782425 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Getting quotas for user aa29a179127b4f5eb248a1c2855fbffd and project 805d142a25a246379bd17aadd8173851. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:46:53.794147 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] [instance: 6f7edb6d-2e8b-484d-b42b-ca9c07de773d] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:46:53.796040 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:53.796684 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:53.812683 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] [instance: 6f7edb6d-2e8b-484d-b42b-ca9c07de773d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:46:53.814501 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:53.815113 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:53.875779 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:46:53.878325 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-074c7096-609c-4e34-b258-803b9792b4cc tempest-InstanceActionsTestJSON-1376986239 tempest-InstanceActionsTestJSON-1376986239-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:46:55.189181 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:47:52.627476 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:47:54.512594 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Took 1.14 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:47:54.561090 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:47:54.562061 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:47:54.688324 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:47:54.689231 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:47:54.692960 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:47:54.695125 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:47:54.744714 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Getting quotas for project 303e6f5ee7d146eb8e039f6fe07520e0. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:47:54.758154 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Getting quotas for user d4d2d52cd5f84165be464d6a477beb65 and project 303e6f5ee7d146eb8e039f6fe07520e0. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:47:54.778377 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] [instance: 062c2dce-f259-4512-815c-53d98bf8354d] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:47:54.780103 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:47:54.780722 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:47:54.790898 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] [instance: 062c2dce-f259-4512-815c-53d98bf8354d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:47:54.793162 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:47:54.794270 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:47:54.861687 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:47:54.862158 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-1352c8ac-0d16-49fb-aee0-1b6d2a2ae626 tempest-ServerAddressesNegativeTestJSON-1568465234 tempest-ServerAddressesNegativeTestJSON-1568465234-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:23.572819 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:48:23.637313 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:23.637622 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:23.768339 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:23.768883 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:23.769604 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:23.769989 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:23.804988 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Getting quotas for project c3959a3a87ff46bfbfcee787d24cfa2d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:48:23.816756 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Getting quotas for user 2f5d8eee9f2b4c3fa1fa78b9537f2467 and project c3959a3a87ff46bfbfcee787d24cfa2d. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:48:23.853932 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] [instance: 8d80c50f-4b10-4a2d-99bf-00abfc07cff9] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:48:23.854470 n-d-764292-25 nova-conductor[98810]: DEBUG nova.scheduler.utils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-764292-25']) and/or node ([]) {{(pid=98810) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} May 28 02:48:23.855292 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:23.855676 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:23.888136 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] [instance: 8d80c50f-4b10-4a2d-99bf-00abfc07cff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:48:23.889806 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:23.890202 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:23.955274 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:23.955274 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4a47988c-f57a-4c56-981a-d51100804fde tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:25.988715 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:48:26.055117 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:26.055780 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:26.265617 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:26.266413 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:26.267397 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:26.267986 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:26.326229 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Getting quotas for project a51cf26b1a1f4c85ac90b69db33e421e. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:48:26.334621 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Getting quotas for user 11f54d094f0f4b9ba0e2c3bc6e200304 and project a51cf26b1a1f4c85ac90b69db33e421e. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:48:26.369364 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] [instance: 72c0aa4b-907c-48e4-8b47-3f2f99f0afc7] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:48:26.370355 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:26.370761 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:26.391385 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] [instance: 72c0aa4b-907c-48e4-8b47-3f2f99f0afc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:48:26.392729 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:26.393208 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:26.456682 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:26.457262 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-354eeb48-8d3d-43be-bae8-c73a93bd05fb tempest-ServersNegativeTestMultiTenantJSON-1453920862 tempest-ServersNegativeTestMultiTenantJSON-1453920862-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:36.824182 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 02:48:37.844110 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 39256. May 28 02:48:49.770679 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:49.771339 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:50.047114 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:48:50.076333 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:50.076952 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:50.158831 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:50.159244 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:50.159974 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:50.160368 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:50.180160 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Getting quotas for project e10e1737f2574ddc9a982f0bd1b9f1b1. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:48:50.187441 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Getting quotas for user a6d6c4cf87af44bb8a530d6eb4338348 and project e10e1737f2574ddc9a982f0bd1b9f1b1. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:48:50.199211 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] [instance: e3ed2456-81fe-4f9a-a8b4-e0e59867de15] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:48:50.200436 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:50.200989 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:50.209930 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] [instance: e3ed2456-81fe-4f9a-a8b4-e0e59867de15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:48:50.211816 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:50.212484 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:50.253687 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:50.254854 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7e7a512-3531-4794-88f7-a0e85e12100e tempest-ServerGroupTestJSON-449218268 tempest-ServerGroupTestJSON-449218268-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:58.946535 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:48:58.989162 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:58.989503 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:59.077679 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:59.078074 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:59.085411 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:59.086160 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:59.126480 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Getting quotas for project c3959a3a87ff46bfbfcee787d24cfa2d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:48:59.132201 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Getting quotas for user 2f5d8eee9f2b4c3fa1fa78b9537f2467 and project c3959a3a87ff46bfbfcee787d24cfa2d. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:48:59.155994 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] [instance: d99de39a-2cf7-4276-b362-b70852e11be4] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:48:59.158973 n-d-764292-25 nova-conductor[98809]: DEBUG nova.scheduler.utils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-764292-25']) and/or node ([]) {{(pid=98809) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} May 28 02:48:59.160014 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:59.168961 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:59.192511 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] [instance: d99de39a-2cf7-4276-b362-b70852e11be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:48:59.194150 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:59.194732 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:48:59.271501 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:48:59.271917 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-4a826362-578d-43da-b299-98c92b1b5f98 tempest-TestServerMultinode-788899465 tempest-TestServerMultinode-788899465-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:49:22.858272 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:49:23.881328 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40452. May 28 02:49:50.476483 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-79313a80-894f-46c9-9af6-89047006dd3f tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method unshelve_instance {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:49:50.477068 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-79313a80-894f-46c9-9af6-89047006dd3f tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:49:50.485643 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-79313a80-894f-46c9-9af6-89047006dd3f tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:49:52.998121 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-79313a80-894f-46c9-9af6-89047006dd3f tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] [instance: d1438204-9351-44e8-a502-0609d7f0a901] Requesting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) during scheduling {{(pid=98810) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 28 02:49:53.503903 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-79313a80-894f-46c9-9af6-89047006dd3f tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:49:53.522920 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-79313a80-894f-46c9-9af6-89047006dd3f tempest-ServersNegativeTestJSON-643422052 tempest-ServersNegativeTestJSON-643422052-project] Lazy-loading 'flavor' on Instance uuid d1438204-9351-44e8-a502-0609d7f0a901 {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:50:15.216016 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:50:18.880884 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:50:18.931805 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:18.932212 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:19.024232 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:19.024917 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:19.025830 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:19.026421 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:19.059239 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Getting quotas for project 0aea017992bc4d7b8abf3d8e9d9df839. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:50:19.070620 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Getting quotas for user fdedcb97fa80471d99193789ca58f325 and project 0aea017992bc4d7b8abf3d8e9d9df839. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:50:19.097607 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] [instance: fc4bbaf1-b139-47b4-a0fa-55e80b3a1d4b] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:50:19.098799 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:19.099355 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:19.117477 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] [instance: fc4bbaf1-b139-47b4-a0fa-55e80b3a1d4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:50:19.119065 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:19.119738 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:19.194484 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:19.195142 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9742f19c-c2ff-471c-90c8-9fe402a71f47 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:20.066803 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:50:20.143905 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:20.147284 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:20.239346 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:20.240172 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:20.241903 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:20.242550 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:20.270758 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Getting quotas for project 5721a5a88ed54be5ac0153432dddca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:50:20.277906 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Getting quotas for user ca08fbd3c182479b889716ce20cb734c and project 5721a5a88ed54be5ac0153432dddca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:50:20.295646 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] [instance: 7366f57d-b0f7-4864-bd4c-c3a29eb958a8] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:50:20.297068 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:20.297782 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:20.321376 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] [instance: 7366f57d-b0f7-4864-bd4c-c3a29eb958a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:50:20.322944 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:20.323502 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:20.385328 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:20.385740 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-db244afa-7634-4978-b185-25ecd657041b tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:30.802585 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:50:30.825725 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:30.826431 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:30.899525 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:30.899936 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:30.900665 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:30.901053 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:30.929978 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Getting quotas for project cb1cca612ba54c209117b171e782d387. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:50:30.943974 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Getting quotas for user 76aa4da374284300adc8fd8e6c89f3a0 and project cb1cca612ba54c209117b171e782d387. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:50:30.972920 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] [instance: 2ccacaaf-7a0c-4568-994f-335dfd53d0dc] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:50:30.975066 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:30.975471 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:30.988683 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] [instance: 2ccacaaf-7a0c-4568-994f-335dfd53d0dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:50:30.989996 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:30.990430 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:50:31.049176 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:50:31.049838 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9589f7a7-8d0e-434c-a164-89b9b43c7339 tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:51:12.656826 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:51:25.863090 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:51:25.900309 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:51:25.900719 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:51:25.990221 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:51:25.990657 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:51:25.991392 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:51:25.991780 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:51:26.027987 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Getting quotas for project 0aea017992bc4d7b8abf3d8e9d9df839. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:51:26.036320 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Getting quotas for user fdedcb97fa80471d99193789ca58f325 and project 0aea017992bc4d7b8abf3d8e9d9df839. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:51:26.061987 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] [instance: 877dbabf-1a74-43bb-88d7-3e96d5010a22] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:51:26.063211 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:51:26.063800 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:51:26.083469 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] [instance: 877dbabf-1a74-43bb-88d7-3e96d5010a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:51:26.089686 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:51:26.090332 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:51:26.157902 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:51:26.158628 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86ed8bda-669a-4526-b41f-be64a0d601d6 tempest-ServerRescueTestJSON-1635522475 tempest-ServerRescueTestJSON-1635522475-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:51:37.843106 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:51:38.868488 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43566. May 28 02:52:17.534666 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:52:17.583188 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:52:17.584533 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:52:17.671941 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:52:17.672627 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:52:17.673680 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:52:17.674504 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:52:17.695311 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Getting quotas for project cb1cca612ba54c209117b171e782d387. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:52:17.705779 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Getting quotas for user 76aa4da374284300adc8fd8e6c89f3a0 and project cb1cca612ba54c209117b171e782d387. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:52:17.718776 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] [instance: 63542c9b-a32b-4346-b56c-69d1414f77d5] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:52:17.720157 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:52:17.720751 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:52:17.731968 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] [instance: 63542c9b-a32b-4346-b56c-69d1414f77d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:52:17.734108 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:52:17.734824 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:52:17.784325 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:52:17.790349 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a968a015-2fd1-436b-aec8-96430a14a58e tempest-VolumesSnapshotTestJSON-1918460036 tempest-VolumesSnapshotTestJSON-1918460036-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:52:23.879159 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 02:52:24.920232 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44866. May 28 02:53:01.487954 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Took 1.04 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:53:01.573470 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:53:01.587467 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:53:01.743629 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:53:01.745432 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:53:01.746754 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:53:01.747456 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:53:01.822761 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Getting quotas for project ec3c96f431ad4b79959809afb1112336. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:53:01.834754 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Getting quotas for user bed9d5063cbb482ba3071ee0bb33a3b3 and project ec3c96f431ad4b79959809afb1112336. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:53:01.859137 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] [instance: 1c2e6a7e-ea16-42c6-8239-7bb4f31dda6b] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:53:01.860602 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:53:01.861244 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:53:01.872079 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] [instance: 1c2e6a7e-ea16-42c6-8239-7bb4f31dda6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:53:01.874464 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:53:01.875225 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:53:01.928345 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:53:01.929490 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-99e6169c-5d49-4e03-b530-6b5030d44114 tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:53:09.110098 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-f236e68b-1ebe-4ee1-8338-c035c5155ace tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method rebuild_instance {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:53:09.110683 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f236e68b-1ebe-4ee1-8338-c035c5155ace tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:53:09.111290 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f236e68b-1ebe-4ee1-8338-c035c5155ace tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:53:09.130913 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-f236e68b-1ebe-4ee1-8338-c035c5155ace tempest-ServerShowV254Test-310909962 tempest-ServerShowV254Test-310909962-project] [instance: 1c2e6a7e-ea16-42c6-8239-7bb4f31dda6b] No migration record for the rebuild/evacuate request. {{(pid=98809) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 02:54:23.598816 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:54:24.621607 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 47132. May 28 02:54:26.172525 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-443c4deb-0347-49df-ac08-72fa868cf7e1 tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method unshelve_instance {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:54:26.173877 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-443c4deb-0347-49df-ac08-72fa868cf7e1 tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:54:26.174729 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-443c4deb-0347-49df-ac08-72fa868cf7e1 tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:54:26.522617 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-443c4deb-0347-49df-ac08-72fa868cf7e1 tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] [instance: 7366f57d-b0f7-4864-bd4c-c3a29eb958a8] Requesting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) during scheduling {{(pid=98810) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 28 02:54:26.940340 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-443c4deb-0347-49df-ac08-72fa868cf7e1 tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:54:26.950943 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-443c4deb-0347-49df-ac08-72fa868cf7e1 tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lazy-loading 'flavor' on Instance uuid 7366f57d-b0f7-4864-bd4c-c3a29eb958a8 {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 02:54:32.685571 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:54:38.867857 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 02:54:39.903098 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 47440. May 28 02:54:43.619703 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:55:15.244327 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:55:24.917972 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 02:55:25.955597 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 48830. May 28 02:55:49.378976 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:55:50.413904 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 49884. May 28 02:55:57.789692 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:55:57.818325 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:55:57.819091 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:55:57.901434 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:55:57.901827 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:55:57.903673 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:55:57.904252 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:55:57.922839 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Getting quotas for project 649d12d5fe2e4dffa0552ef03dc10e4c. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:55:57.928430 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Getting quotas for user f91b88e56f7c4f1da3357aa8092ddaca and project 649d12d5fe2e4dffa0552ef03dc10e4c. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:55:57.942517 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] [instance: 71e46744-a4e1-4833-a946-c838e0f3aa76] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:55:57.944087 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:55:57.944479 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:55:57.963320 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] [instance: 71e46744-a4e1-4833-a946-c838e0f3aa76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:55:57.964568 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:55:57.964969 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:55:58.032649 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:55:58.033216 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-05f91c48-f4ac-4853-93ee-6887e0cdf8cc tempest-VolumesNegativeTest-1156335445 tempest-VolumesNegativeTest-1156335445-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:02.610312 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:56:02.647894 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:02.648399 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:02.741152 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:02.741538 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:02.742365 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:02.742759 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:02.778741 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Getting quotas for project b66e22569642477095333992e01f42d6. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:56:02.787785 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Getting quotas for user 0327ffea56514cff9966a5c8654d5280 and project b66e22569642477095333992e01f42d6. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:56:02.799943 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] [instance: 6c217e5a-36d7-4184-9390-cba64972056f] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:56:02.801135 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:02.801751 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:02.811878 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] [instance: 6c217e5a-36d7-4184-9390-cba64972056f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:56:02.812924 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:02.813356 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:02.880594 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:02.880994 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:02.899849 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] [466bda2a-ee95-4713-9d2f-0a47cd8db1e8] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 02:56:03.922042 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [None req-89a705b2-9a89-46f4-be69-0e64ae4e6300 tempest-VolumesBackupsTest-723847092 tempest-VolumesBackupsTest-723847092-project] [466bda2a-ee95-4713-9d2f-0a47cd8db1e8] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 50416. May 28 02:56:57.936833 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:56:57.988474 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:57.988875 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:58.077230 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:58.077742 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:58.078420 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:58.079734 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:58.115086 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Getting quotas for project 5721a5a88ed54be5ac0153432dddca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:56:58.127827 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Getting quotas for user ca08fbd3c182479b889716ce20cb734c and project 5721a5a88ed54be5ac0153432dddca8f. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:56:58.182999 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] [instance: e37c9332-dd4c-4a77-9b79-7daaccd48023] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:56:58.183997 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:58.184396 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:58.197301 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] [instance: e37c9332-dd4c-4a77-9b79-7daaccd48023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:56:58.198983 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:58.199530 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:58.249796 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:58.251212 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-4e9697ea-94a0-45ea-a459-086d725c488a tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:56:59.812549 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:56:59.885495 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:56:59.885916 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:00.010372 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:00.012530 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:00.012530 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:00.013865 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:00.041646 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Getting quotas for project e42949abb20946eba3ecc52d4dba99dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:57:00.053473 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Getting quotas for user e75085cdb1384b2c9471e3594352edca and project e42949abb20946eba3ecc52d4dba99dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:57:00.072343 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] [instance: 9fd05fd2-5287-49bd-b28a-743736199ad5] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:57:00.073439 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:00.073935 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:00.082767 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] [instance: 9fd05fd2-5287-49bd-b28a-743736199ad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:57:00.084374 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:00.084873 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:00.157178 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:00.157752 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a81d4ef4-2d9d-41f5-86ef-f976dadc01b7 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:39.895869 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 02:57:40.914207 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 53662. May 28 02:57:52.454622 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:57:52.477505 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:52.477938 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:52.538805 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:52.539258 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:52.539994 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:52.540384 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:52.563095 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Getting quotas for project f95042099df7480da733189791c668c2. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:57:52.569305 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Getting quotas for user 86d114b65523490b8830dbea40884ae3 and project f95042099df7480da733189791c668c2. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:57:52.586731 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] [instance: b7793d80-3c96-493b-80ae-ad0081dc89b1] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:57:52.588316 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:52.588718 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:52.598415 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] [instance: b7793d80-3c96-493b-80ae-ad0081dc89b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:57:52.600068 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:52.600632 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:52.649228 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:52.650502 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-ae00d09f-7da2-4852-9ebc-f6bdb200d207 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:52.716513 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:57:54.661771 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:57:54.688375 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:54.690626 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:54.749386 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:54.749945 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:54.750710 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:54.751106 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:54.768088 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Getting quotas for project 1160ac018b684e67aa959988d500719f. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:57:54.773216 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Getting quotas for user d340ecad3c1a4e95a6e33d777e6dc829 and project 1160ac018b684e67aa959988d500719f. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:57:54.783805 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] [instance: 5726217a-092e-44e5-be48-80faffec199f] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:57:54.784749 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:54.785148 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:54.791842 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] [instance: 5726217a-092e-44e5-be48-80faffec199f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:57:54.793310 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:54.793717 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:57:54.820882 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:57:54.821305 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-a9231035-8858-4a7b-aff3-91ec0ff51f8e tempest-VolumesActionsTest-2127562332 tempest-VolumesActionsTest-2127562332-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:58:25.950826 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 02:58:26.968960 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 54882. May 28 02:58:35.265863 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 02:58:36.210425 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-6b0707d2-2d91-4fc5-9afe-44545c9fe83f tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 02:58:36.211121 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6b0707d2-2d91-4fc5-9afe-44545c9fe83f tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:58:36.211510 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-6b0707d2-2d91-4fc5-9afe-44545c9fe83f tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:58:36.510202 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-6b0707d2-2d91-4fc5-9afe-44545c9fe83f tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] [instance: 9fd05fd2-5287-49bd-b28a-743736199ad5] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98810) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 02:58:36.882224 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-6b0707d2-2d91-4fc5-9afe-44545c9fe83f tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Created allocations for migration 52107906-849a-435e-ad7f-305bef8b5f0a on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98810) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 02:58:37.246464 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-6b0707d2-2d91-4fc5-9afe-44545c9fe83f tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] [instance: 9fd05fd2-5287-49bd-b28a-743736199ad5] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98810) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 02:58:37.300803 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_db.api [None req-6b0707d2-2d91-4fc5-9afe-44545c9fe83f tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') May 28 02:58:37.300803 n-d-764292-25 nova-conductor[98810]: [SQL: UPDATE instance_actions SET updated_at=%(updated_at)s WHERE instance_actions.id = %(instance_actions_id)s] May 28 02:58:37.300803 n-d-764292-25 nova-conductor[98810]: [parameters: {'updated_at': datetime.datetime(2021, 5, 28, 2, 58, 37, 282713), 'instance_actions_id': 387}] May 28 02:58:37.300803 n-d-764292-25 nova-conductor[98810]: (Background on this error at: http://sqlalche.me/e/13/e3q8) {{(pid=98810) _is_exception_expected /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:184}} May 28 02:58:37.301215 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_db.api [None req-6b0707d2-2d91-4fc5-9afe-44545c9fe83f tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Performing DB retry for function nova.db.sqlalchemy.api.action_event_finish {{(pid=98810) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 28 02:59:32.521502 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 02:59:32.546773 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:59:32.547289 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:59:32.602510 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:59:32.602954 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:59:32.603919 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:59:32.605094 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:59:32.626328 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Getting quotas for project f95042099df7480da733189791c668c2. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 02:59:32.632197 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Getting quotas for user 86d114b65523490b8830dbea40884ae3 and project f95042099df7480da733189791c668c2. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 02:59:32.645321 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] [instance: 3c5c4fd6-aaf7-487a-93dd-518c33a84434] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 02:59:32.646906 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:59:32.647459 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:59:32.657428 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] [instance: 3c5c4fd6-aaf7-487a-93dd-518c33a84434] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 02:59:32.659427 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:59:32.659838 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 02:59:32.700801 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 02:59:32.701183 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-076dda5e-0349-47f3-97dd-40f94b168760 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:00:18.892672 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:00:18.946671 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:00:18.947074 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:00:19.037963 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:00:19.038396 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:00:19.039123 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:00:19.050657 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:00:19.074497 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Getting quotas for project e42949abb20946eba3ecc52d4dba99dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:00:19.079467 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Getting quotas for user e75085cdb1384b2c9471e3594352edca and project e42949abb20946eba3ecc52d4dba99dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:00:19.090821 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] [instance: 963453cc-7c92-4a1e-9705-f5d51e76fdb2] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:00:19.094570 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:00:19.094979 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:00:19.103882 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] [instance: 963453cc-7c92-4a1e-9705-f5d51e76fdb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:00:19.105317 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:00:19.105831 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:00:19.162595 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:00:19.163144 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f9e574d4-3c6d-4d0b-9a6d-c3c5d6dd0935 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:00:40.914478 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:00:41.493893 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-fdc5accd-5dbe-4286-917b-a31598b7221c tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method unshelve_instance {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:00:41.494817 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fdc5accd-5dbe-4286-917b-a31598b7221c tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:00:41.496010 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-fdc5accd-5dbe-4286-917b-a31598b7221c tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:00:41.935182 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 57704. May 28 03:00:42.256828 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-fdc5accd-5dbe-4286-917b-a31598b7221c tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] [instance: e37c9332-dd4c-4a77-9b79-7daaccd48023] Requesting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) during scheduling {{(pid=98809) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 28 03:00:42.491780 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-fdc5accd-5dbe-4286-917b-a31598b7221c tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:00:42.500393 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance [None req-fdc5accd-5dbe-4286-917b-a31598b7221c tempest-AttachVolumeShelveTestJSON-119823858 tempest-AttachVolumeShelveTestJSON-119823858-project] Lazy-loading 'flavor' on Instance uuid e37c9332-dd4c-4a77-9b79-7daaccd48023 {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 03:01:06.183905 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:01:06.210398 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:01:06.210969 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:01:06.275628 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:01:06.276025 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:01:06.276744 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:01:06.281349 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:01:06.296815 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Getting quotas for project f95042099df7480da733189791c668c2. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:01:06.301177 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Getting quotas for user 86d114b65523490b8830dbea40884ae3 and project f95042099df7480da733189791c668c2. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:01:06.312771 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] [instance: 3760b2fa-f3e0-4a54-ac7e-2dfc820370ae] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:01:06.313701 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:01:06.314104 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:01:06.321568 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] [instance: 3760b2fa-f3e0-4a54-ac7e-2dfc820370ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:01:06.322804 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:01:06.323202 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:01:06.357315 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:01:06.357736 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d7bcf32a-a7f9-475f-9825-c48cc37cc258 tempest-TestNetworkBasicOps-1348833669 tempest-TestNetworkBasicOps-1348833669-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:01:12.744143 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:01:26.969810 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:01:27.986130 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 58898. May 28 03:01:42.471733 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-74fa31a5-b48f-4933-946e-0c27ac4105e6 tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:01:42.472335 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74fa31a5-b48f-4933-946e-0c27ac4105e6 tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:01:42.472639 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74fa31a5-b48f-4933-946e-0c27ac4105e6 tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:01:42.588013 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-74fa31a5-b48f-4933-946e-0c27ac4105e6 tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] [instance: 963453cc-7c92-4a1e-9705-f5d51e76fdb2] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98809) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 03:01:42.946608 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-74fa31a5-b48f-4933-946e-0c27ac4105e6 tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Created allocations for migration 98659c60-7f37-4a84-a10f-fa7bbd6ca810 on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 03:01:43.150003 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-74fa31a5-b48f-4933-946e-0c27ac4105e6 tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] [instance: 963453cc-7c92-4a1e-9705-f5d51e76fdb2] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [] {{(pid=98809) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 03:01:55.291387 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:02:10.715060 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:02:10.764921 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:02:10.765349 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:02:10.820933 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:02:10.821662 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:02:10.822621 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:02:10.823161 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:02:10.844247 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:02:10.849629 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for user 2858e96eee9b4e28ab8b3a1b170685b1 and project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:02:10.864873 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 3f875182-42f0-499c-b700-5a14e176a6b7] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:02:10.867366 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:02:10.867966 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:02:10.886226 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 3f875182-42f0-499c-b700-5a14e176a6b7] block_device_mapping [BlockDeviceMapping(attachment_id=3c440481-eaf2-4b01-8719-49ae06786882,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a348c92-1d9f-40e2-a3dd-b39258a728cf',volume_size=1,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:02:10.887547 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:02:10.887956 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:02:10.957555 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:02:10.958016 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-3425f4ea-2ee9-4f09-b6e9-9fd53eb8a542 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.264580 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:03:07.301346 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.301871 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.359027 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.359576 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.360815 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.361353 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.394753 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:03:07.403081 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for user 2858e96eee9b4e28ab8b3a1b170685b1 and project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:03:07.416648 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 8a2ddd86-5693-48a2-bb4f-4d320ee1d8f5] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:03:07.417820 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.418191 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.443702 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 8a2ddd86-5693-48a2-bb4f-4d320ee1d8f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3fa4b212-5444-42e1-b823-f88863d710ae',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:03:07.446138 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.446816 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.499676 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.500117 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-2e3d6cda-d039-4ff1-8cce-a1bcf9cb2df4 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.697868 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:03:07.727238 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.727947 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.800412 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.801137 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.802168 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.802738 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.831987 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Getting quotas for project bc76b0d130834562b764956972efa459. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:03:07.838468 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Getting quotas for user c35b510723ed453bb6b3842d65d65156 and project bc76b0d130834562b764956972efa459. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:03:07.852639 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] [instance: e4605b06-dba1-4439-b71a-3078ca51f576] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:03:07.853830 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.855017 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.863203 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] [instance: e4605b06-dba1-4439-b71a-3078ca51f576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:03:07.864542 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.865013 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:07.908465 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:07.908873 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e2485009-027d-412a-b271-ee870dbd1be4 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:41.936453 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:03:42.399869 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:03:42.429024 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:42.430715 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:42.499954 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:42.500691 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:42.502159 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:42.502759 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:42.522468 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Getting quotas for project e42949abb20946eba3ecc52d4dba99dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:03:42.527935 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Getting quotas for user e75085cdb1384b2c9471e3594352edca and project e42949abb20946eba3ecc52d4dba99dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:03:42.540988 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] [instance: 1b62e583-bdc3-4739-bfea-42698f1c57e7] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:03:42.541941 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:42.542410 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:42.552219 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] [instance: 1b62e583-bdc3-4739-bfea-42698f1c57e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:03:42.553970 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:42.554605 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:42.610763 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:03:42.611172 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-31602b2c-e232-4b10-adec-f38a4361e5a6 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:03:42.960682 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 33020. May 28 03:04:16.089124 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:04:16.110130 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:16.110568 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:16.152245 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:16.152642 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:16.153368 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:16.153758 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:16.168473 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:04:16.172771 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for user 2858e96eee9b4e28ab8b3a1b170685b1 and project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:04:16.183342 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 888dc489-3497-47bf-a741-282f7e71fc75] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:04:16.184436 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:16.184827 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:16.192004 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 888dc489-3497-47bf-a741-282f7e71fc75] block_device_mapping [BlockDeviceMapping(attachment_id=c5ef6d14-6196-4eed-b2f3-b8a89b8c4489,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52934ce3-f32d-43dc-9649-ef536feca5a6',volume_size=1,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:04:16.193658 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:16.194066 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:16.223130 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:16.223699 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-d81add1a-0069-4767-b1da-1e533d6afb60 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:27.988873 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:04:29.011463 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 33484. May 28 03:04:32.763826 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:04:40.622538 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:04:40.645944 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:40.646385 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:40.727734 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:40.728431 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:40.729297 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:40.729775 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:40.745997 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:04:40.750521 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for user 2858e96eee9b4e28ab8b3a1b170685b1 and project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:04:40.761436 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 9e08ce00-7ad9-45bd-b0fe-7ae9502a794c] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:04:40.762394 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:40.762798 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:40.769249 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 9e08ce00-7ad9-45bd-b0fe-7ae9502a794c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f1f39326-f6bd-4f4e-99d7-a8ecb699c83a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:04:40.770763 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:40.771948 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:04:40.805323 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:04:40.805762 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-72bed9d1-ab41-4cf3-9d09-c72b2907c517 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:05:00.026500 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:05:00.051694 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:05:00.051694 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:05:00.113561 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:05:00.114274 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:05:00.115183 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:05:00.115534 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:05:00.136880 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Getting quotas for project bc76b0d130834562b764956972efa459. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:05:00.141829 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Getting quotas for user c35b510723ed453bb6b3842d65d65156 and project bc76b0d130834562b764956972efa459. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:05:00.153465 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] [instance: 28b21682-2c56-4a9a-b5ac-b9c5be7798c1] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:05:00.157339 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:05:00.157941 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:05:00.166763 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] [instance: 28b21682-2c56-4a9a-b5ac-b9c5be7798c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:05:00.171833 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:05:00.171833 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:05:00.225164 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:05:00.225577 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-dc8f15b7-db2a-4e97-8fa5-c914a3649067 tempest-TestSecurityGroupsBasicOps-1755978741 tempest-TestSecurityGroupsBasicOps-1755978741-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:05:13.803794 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-5478abf5-3b07-47fb-b0ac-3f4eee2ea24b tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:05:13.805098 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5478abf5-3b07-47fb-b0ac-3f4eee2ea24b tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:05:13.805768 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5478abf5-3b07-47fb-b0ac-3f4eee2ea24b tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:05:14.481307 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-5478abf5-3b07-47fb-b0ac-3f4eee2ea24b tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Created allocations for migration 8ef722b3-8b7f-4f74-8f49-8d8641e0e5b6 on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 03:05:14.675622 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.live_migrate [None req-5478abf5-3b07-47fb-b0ac-3f4eee2ea24b tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] [instance: 1b62e583-bdc3-4739-bfea-42698f1c57e7] Requesting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while live migrating {{(pid=98809) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:494}} May 28 03:05:14.948625 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance [None req-5478abf5-3b07-47fb-b0ac-3f4eee2ea24b tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Lazy-loading 'resources' on Instance uuid 1b62e583-bdc3-4739-bfea-42698f1c57e7 {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 03:05:14.952827 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance [None req-5478abf5-3b07-47fb-b0ac-3f4eee2ea24b tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] Lazy-loading 'pci_requests' on Instance uuid 1b62e583-bdc3-4739-bfea-42698f1c57e7 {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 03:05:15.218637 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.live_migrate [None req-5478abf5-3b07-47fb-b0ac-3f4eee2ea24b tempest-TestNetworkAdvancedServerOps-414037854 tempest-TestNetworkAdvancedServerOps-414037854-project-admin] [instance: 1b62e583-bdc3-4739-bfea-42698f1c57e7] Start binding ports on destination host: n-h1-764292-25 {{(pid=98809) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 28 03:05:15.311565 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:06:10.805568 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:06:10.835659 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:10.836063 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:10.926947 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:10.927557 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:10.928478 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:10.929043 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:10.949327 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Getting quotas for project e42949abb20946eba3ecc52d4dba99dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:06:10.955680 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Getting quotas for user e75085cdb1384b2c9471e3594352edca and project e42949abb20946eba3ecc52d4dba99dd. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:06:10.968163 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] [instance: 54d7208c-8dda-40ec-9a59-d25ca5163a64] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:06:10.969105 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:10.970032 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:10.981634 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] [instance: 54d7208c-8dda-40ec-9a59-d25ca5163a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:06:10.984127 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:10.985079 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:11.040402 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:11.041067 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-43e5bda7-5c2f-42d9-b901-fc77e63454a5 tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:15.465077 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:06:15.500479 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:15.501271 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:15.593745 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:15.594162 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:15.594902 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:15.595285 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:15.637088 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:06:15.646353 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for user 2858e96eee9b4e28ab8b3a1b170685b1 and project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:06:15.672364 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 68d69be3-39ee-4046-88ac-0c9fee9b6a65] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:06:15.675466 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:15.675879 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:15.712483 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 68d69be3-39ee-4046-88ac-0c9fee9b6a65] block_device_mapping [BlockDeviceMapping(attachment_id=d234986b-2d15-4ec2-9a2b-3df5851451d3,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e0cdf6e-a53f-4d90-9dd9-883b4171cb60',volume_size=1,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:06:15.714439 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:15.715564 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:15.778266 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:15.780376 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-b90f3a57-234b-4d47-977d-aaf1ed89137b tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:26.493830 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:06:26.535642 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:26.536054 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:26.637335 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:26.638093 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:26.639726 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:26.640335 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:26.662653 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Getting quotas for project 219f13c5c2dc4cccbcc2a5238d6305f7. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:06:26.668014 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Getting quotas for user d47be456d58f4ffd9553533d03fe3766 and project 219f13c5c2dc4cccbcc2a5238d6305f7. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:06:26.703240 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] [instance: 1b273703-e1bd-44c8-8046-8dae54909c89] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:06:26.704342 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:26.704930 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:26.724663 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] [instance: 1b273703-e1bd-44c8-8046-8dae54909c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:06:26.725984 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:26.726436 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:26.767051 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:06:26.768072 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1c6a7726-3838-43b8-8c99-ee5fc50c9afa tempest-TestServerBasicOps-964631383 tempest-TestServerBasicOps-964631383-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:06:42.957310 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:06:43.987514 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 35702. May 28 03:07:29.011791 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:07:30.027137 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 36038. May 28 03:07:45.572788 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0cb69816-f7b1-4908-bf76-789e67c3618e tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method rebuild_instance {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:07:45.573426 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0cb69816-f7b1-4908-bf76-789e67c3618e tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:07:45.573673 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0cb69816-f7b1-4908-bf76-789e67c3618e tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:07:45.590367 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0cb69816-f7b1-4908-bf76-789e67c3618e tempest-TestNetworkAdvancedServerOps-905849853 tempest-TestNetworkAdvancedServerOps-905849853-project] [instance: 54d7208c-8dda-40ec-9a59-d25ca5163a64] No migration record for the rebuild/evacuate request. {{(pid=98809) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 28 03:07:52.783821 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:08:24.645539 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:08:25.663900 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 36144. May 28 03:08:44.282461 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:08:44.304678 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:08:44.305091 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:08:44.346903 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:08:44.347305 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:08:44.348026 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:08:44.348415 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:08:44.363282 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:08:44.367628 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for user 2858e96eee9b4e28ab8b3a1b170685b1 and project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:08:44.378129 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: d39cf8fb-30dd-43f2-a578-e9624faaf30e] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:08:44.379039 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:08:44.379433 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:08:44.386613 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: d39cf8fb-30dd-43f2-a578-e9624faaf30e] block_device_mapping [BlockDeviceMapping(attachment_id=c2cba33f-006c-4618-8a1c-788a61ce86c5,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e0cdf6e-a53f-4d90-9dd9-883b4171cb60',volume_size=1,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:08:44.387793 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:08:44.388212 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:08:44.413882 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:08:44.414310 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-94c96ab8-450b-4e69-bc1f-6899381c8788 tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:09:31.852042 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:09:31.873165 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:09:31.873570 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:09:31.921093 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:09:31.921409 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:09:31.922137 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:09:31.922558 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:09:31.937714 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Getting quotas for project 145a38971ca84c18abccfde09854de23. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:09:31.942122 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Getting quotas for user ceaff5a102364935b3be6499950fdfc5 and project 145a38971ca84c18abccfde09854de23. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:09:31.952885 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] [instance: bc327505-e877-4462-a06d-706821414e19] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:09:31.953765 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:09:31.954158 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:09:31.960634 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] [instance: bc327505-e877-4462-a06d-706821414e19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:09:31.961789 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:09:31.962191 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:09:31.988417 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:09:31.988816 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-cb7e7f10-2d30-4dab-8aa9-0f8bdae4509e tempest-TestServerAdvancedOps-1169650782 tempest-TestServerAdvancedOps-1169650782-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:09:43.988698 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:09:45.005703 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 36470. May 28 03:10:15.339717 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:10:30.028375 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:10:31.045534 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 36564. May 28 03:10:46.251388 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:10:46.282759 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:10:47.270173 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 36590. May 28 03:10:48.353074 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:10:49.389608 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 36596. May 28 03:10:55.714563 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:10:55.736944 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:10:55.737434 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:10:55.782997 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:10:55.783440 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:10:55.784235 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:10:55.784626 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:10:55.800393 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:10:55.805210 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Getting quotas for user 2858e96eee9b4e28ab8b3a1b170685b1 and project 7ff75d14d32640a6b5f253c156b96ce7. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:10:55.815892 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 3b19f6ed-f235-45a7-b8fc-4280163f8c72] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:10:55.816802 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:10:55.817199 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:10:55.823620 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] [instance: 3b19f6ed-f235-45a7-b8fc-4280163f8c72] block_device_mapping [BlockDeviceMapping(attachment_id=c11bb8c9-80ae-4481-8ddc-f347c62e9d41,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38be8b14-a762-4133-86a1-4f10e62f8097',volume_size=1,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:10:55.824940 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:10:55.825354 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:10:55.852152 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:10:55.852545 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f8341951-3927-4def-bf36-e93979814a7e tempest-TestVolumeBootPattern-245869978 tempest-TestVolumeBootPattern-245869978-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:11:12.799874 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:12:45.007767 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:12:46.024794 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 37010. May 28 03:13:04.567299 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:13:25.666041 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:13:26.699526 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 37400. May 28 03:13:31.047054 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:13:32.064134 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 37460. May 28 03:13:35.355436 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:13:47.271615 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:13:48.288592 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 37610. May 28 03:13:49.379508 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:13:50.406048 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 37644. May 28 03:13:50.415153 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:13:51.437412 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 37664. May 28 03:14:06.304104 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:14:07.853019 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:14:30.688015 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:14:30.709994 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:14:30.710444 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:14:30.760928 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:14:30.761336 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:14:30.762068 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:14:30.762504 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:14:30.777461 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Getting quotas for project 525d6695c6d741a8ba16a111f9326843. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:14:30.781832 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Getting quotas for user d43543658b7a4caa86f2bcc495d1be4a and project 525d6695c6d741a8ba16a111f9326843. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:14:30.792069 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] [instance: 4d76f6f6-f22c-48f3-b88a-e917e96608fa] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:14:30.792896 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:14:30.793296 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:14:30.799410 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] [instance: 4d76f6f6-f22c-48f3-b88a-e917e96608fa] block_device_mapping [BlockDeviceMapping(attachment_id=04349945-780d-4c2a-802d-d4f045dc8b36,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20c7dd83-a65d-486d-94ab-38099826d8b0',volume_size=1,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:14:30.800591 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:14:30.800987 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:14:30.828492 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:14:30.828996 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-86593aae-c4a7-4af4-9402-856ea84056bb tempest-TestVolumeBackupRestore-310701933 tempest-TestVolumeBackupRestore-310701933-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:14:32.817541 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:15:46.026694 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:15:47.042529 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 38774. May 28 03:15:54.765175 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] [d48a76b8-4383-4975-8d43-3659aaff73a9] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 03:15:55.782062 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] [d48a76b8-4383-4975-8d43-3659aaff73a9] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 38824. May 28 03:15:56.166625 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Took 1.41 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:15:56.191034 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:15:56.191455 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:15:56.242179 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:15:56.242548 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:15:56.243278 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:15:56.243672 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:15:56.259807 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Getting quotas for project b4a1c516d1b148639f0d7c5e290f3876. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:15:56.264182 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Getting quotas for user e61a446ec4a049069cfdac6c8feabfeb and project b4a1c516d1b148639f0d7c5e290f3876. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:15:56.275097 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] [instance: bff1269b-6a48-4174-9f24-0a2df49fbd9f] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:15:56.275994 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:15:56.276398 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:15:56.282586 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] [instance: bff1269b-6a48-4174-9f24-0a2df49fbd9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:15:56.283994 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:15:56.284394 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:15:56.310214 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:15:56.310648 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-134305a6-bc1f-41ca-8471-f8570d978b2b tempest-ServersAdminNegativeTestJSON-1952795404 tempest-ServersAdminNegativeTestJSON-1952795404-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:16:17.485743 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:16:17.507886 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:16:17.508293 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:16:17.555872 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:16:17.556278 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:16:17.557012 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:16:17.557410 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:16:17.572995 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Getting quotas for project d136a8c59cd9475fb667cb984305eb84. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:16:17.577460 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Getting quotas for user 9b273c1f912346c2b2c5321961d9ef8b and project d136a8c59cd9475fb667cb984305eb84. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:16:17.587564 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] [instance: e4cefe69-96eb-4231-be79-2be3874f67ff] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:16:17.588459 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:16:17.588862 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:16:17.594878 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] [instance: e4cefe69-96eb-4231-be79-2be3874f67ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:16:17.596036 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:16:17.596438 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:16:17.623352 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:16:17.623855 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-2315ce5e-c7da-4147-ad61-7a8dfb401f75 tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:16:30.004318 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-59699807-31fe-4cf1-990d-6426898ecced tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:16:30.004833 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-59699807-31fe-4cf1-990d-6426898ecced tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:16:30.005178 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-59699807-31fe-4cf1-990d-6426898ecced tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:16:30.162299 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-59699807-31fe-4cf1-990d-6426898ecced tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] [instance: e4cefe69-96eb-4231-be79-2be3874f67ff] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98809) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 03:16:30.488074 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-59699807-31fe-4cf1-990d-6426898ecced tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] Created allocations for migration bd7afa17-bf90-417a-b159-db3817f97dfd on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 03:16:30.689777 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-59699807-31fe-4cf1-990d-6426898ecced tempest-DeleteServersTestJSON-1985418735 tempest-DeleteServersTestJSON-1985418735-project] [instance: e4cefe69-96eb-4231-be79-2be3874f67ff] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [Selection(allocation_request='{"allocations": {"1bff8e46-e9c8-450f-8078-657cbe80b915": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1bff8e46-e9c8-450f-8078-657cbe80b915"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=18c04405-93e8-4472-a3b7-1e908fd6a496,compute_node_uuid=1bff8e46-e9c8-450f-8078-657cbe80b915,limits=SchedulerLimits,nodename='n-h2-764292-25',service_host='n-h2-764292-25')] {{(pid=98809) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 03:16:32.071037 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:16:33.087951 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 39058. May 28 03:16:55.379188 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:17:14.337025 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:17:14.358896 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:17:14.359298 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:17:14.413513 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:17:14.413834 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:17:14.414587 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:17:14.414972 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:17:14.429531 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Getting quotas for project 05184792e9bf488985512d74edfc3009. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:17:14.434219 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Getting quotas for user 7b80dcd403544c67ba0b757fc0d80ad9 and project 05184792e9bf488985512d74edfc3009. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:17:14.444175 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] [instance: 7dd69807-103b-4e28-9119-b838a7714aab] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:17:14.445042 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:17:14.445434 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:17:14.452019 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] [instance: 7dd69807-103b-4e28-9119-b838a7714aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:17:14.453304 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:17:14.453698 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:17:14.479875 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:17:14.480324 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-9d7677aa-fa81-4cc3-9f65-31f5206e8193 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:17:26.333078 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-c568ae2f-12fa-4043-b053-02ae0b1266e1 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:17:26.333631 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c568ae2f-12fa-4043-b053-02ae0b1266e1 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:17:26.334042 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-c568ae2f-12fa-4043-b053-02ae0b1266e1 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:17:26.442349 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-c568ae2f-12fa-4043-b053-02ae0b1266e1 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] [instance: 7dd69807-103b-4e28-9119-b838a7714aab] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98809) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 03:17:26.778732 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-c568ae2f-12fa-4043-b053-02ae0b1266e1 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Created allocations for migration 1353e52a-a51b-44ad-ac00-599611390abe on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 03:17:26.974978 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-c568ae2f-12fa-4043-b053-02ae0b1266e1 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] [instance: 7dd69807-103b-4e28-9119-b838a7714aab] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [Selection(allocation_request='{"allocations": {"1bff8e46-e9c8-450f-8078-657cbe80b915": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1bff8e46-e9c8-450f-8078-657cbe80b915"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=18c04405-93e8-4472-a3b7-1e908fd6a496,compute_node_uuid=1bff8e46-e9c8-450f-8078-657cbe80b915,limits=SchedulerLimits,nodename='n-h2-764292-25',service_host='n-h2-764292-25')] {{(pid=98809) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 03:17:52.835344 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:18:06.034136 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:18:06.055755 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:18:06.056162 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:18:06.097743 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:18:06.098141 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:18:06.098896 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:18:06.099332 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:18:06.114683 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Getting quotas for project 05184792e9bf488985512d74edfc3009. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:18:06.119037 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Getting quotas for user 7b80dcd403544c67ba0b757fc0d80ad9 and project 05184792e9bf488985512d74edfc3009. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:18:06.129754 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] [instance: fccedf14-8a31-43b1-944c-2a6b1a954a42] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:18:06.130692 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:18:06.131090 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:18:06.137869 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] [instance: fccedf14-8a31-43b1-944c-2a6b1a954a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:18:06.139086 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:18:06.139489 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:18:06.167890 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:18:06.168296 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-8c102851-f204-44ef-9d1e-d117b8e44b3c tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:18:18.674619 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-3051157b-c266-413a-b66a-bce36b9fa1c4 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:18:18.675097 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3051157b-c266-413a-b66a-bce36b9fa1c4 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:18:18.675479 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3051157b-c266-413a-b66a-bce36b9fa1c4 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:18:18.790763 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-3051157b-c266-413a-b66a-bce36b9fa1c4 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] [instance: fccedf14-8a31-43b1-944c-2a6b1a954a42] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98809) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 03:18:19.065876 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-3051157b-c266-413a-b66a-bce36b9fa1c4 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] Created allocations for migration 92bc801b-4fda-4336-9b29-d65fd2a09638 on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 03:18:19.263577 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-3051157b-c266-413a-b66a-bce36b9fa1c4 tempest-ServerDiskConfigTestJSON-1099147380 tempest-ServerDiskConfigTestJSON-1099147380-project] [instance: fccedf14-8a31-43b1-944c-2a6b1a954a42] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [Selection(allocation_request='{"allocations": {"1bff8e46-e9c8-450f-8078-657cbe80b915": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1bff8e46-e9c8-450f-8078-657cbe80b915"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=18c04405-93e8-4472-a3b7-1e908fd6a496,compute_node_uuid=1bff8e46-e9c8-450f-8078-657cbe80b915,limits=SchedulerLimits,nodename='n-h2-764292-25',service_host='n-h2-764292-25')] {{(pid=98809) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 03:18:47.044931 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:18:48.062459 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 39488. May 28 03:19:12.343293 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:19:12.366931 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:19:12.367341 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:19:12.444909 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:19:12.445390 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:19:12.447221 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:19:12.447819 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:19:12.465424 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Getting quotas for project e72e643650ea472c930cbb25eb7430bc. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:19:12.470287 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Getting quotas for user 48b9bba099e841ef9ba84a6e3579135e and project e72e643650ea472c930cbb25eb7430bc. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:19:12.481204 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: 92cdc14e-2895-4651-abcc-a8391d42ddf7] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:19:12.482160 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:19:12.482596 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:19:12.490319 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: 92cdc14e-2895-4651-abcc-a8391d42ddf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:19:12.491733 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:19:12.492141 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:19:12.525949 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:19:12.526548 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-7b22eabe-eace-47a4-a53d-d118c4bcd67d tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:19:33.089159 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:19:34.105454 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 39702. May 28 03:20:15.396018 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:20:26.695409 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:20:27.711117 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 39814. May 28 03:20:51.439363 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:20:52.463298 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 39868. May 28 03:21:12.851839 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:21:23.679652 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:21:24.590331 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:21:48.063784 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:21:48.294826 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:21:49.079536 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 39996. May 28 03:21:49.311622 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40000. May 28 03:21:50.408304 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:21:51.431115 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40004. May 28 03:21:58.935008 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-654b7675-ca2e-49bd-9a9c-6f35d9eabdc2 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:21:58.935497 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-654b7675-ca2e-49bd-9a9c-6f35d9eabdc2 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:21:58.935896 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-654b7675-ca2e-49bd-9a9c-6f35d9eabdc2 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:21:59.165891 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-654b7675-ca2e-49bd-9a9c-6f35d9eabdc2 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: 92cdc14e-2895-4651-abcc-a8391d42ddf7] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98809) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 03:21:59.423853 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-654b7675-ca2e-49bd-9a9c-6f35d9eabdc2 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Created allocations for migration ef5efa81-fc18-45bb-a63f-9db0c2d08f06 on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 03:21:59.725235 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-654b7675-ca2e-49bd-9a9c-6f35d9eabdc2 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: 92cdc14e-2895-4651-abcc-a8391d42ddf7] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [Selection(allocation_request='{"allocations": {"1bff8e46-e9c8-450f-8078-657cbe80b915": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1bff8e46-e9c8-450f-8078-657cbe80b915"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=18c04405-93e8-4472-a3b7-1e908fd6a496,compute_node_uuid=1bff8e46-e9c8-450f-8078-657cbe80b915,limits=SchedulerLimits,nodename='n-h2-764292-25',service_host='n-h2-764292-25')] {{(pid=98809) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 03:22:26.326291 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:22:27.817436 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:22:27.839609 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:22:27.840019 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:22:27.873177 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:22:27.899818 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:22:27.900228 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:22:27.900961 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:22:27.901357 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:22:27.919325 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Getting quotas for project e72e643650ea472c930cbb25eb7430bc. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:22:27.923883 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Getting quotas for user 48b9bba099e841ef9ba84a6e3579135e and project e72e643650ea472c930cbb25eb7430bc. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:22:27.934713 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: c05a9367-656e-49d8-b247-2ca11d540d56] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:22:27.935620 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:22:27.936022 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:22:27.942517 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: c05a9367-656e-49d8-b247-2ca11d540d56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:22:27.943824 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:22:27.944233 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:22:27.970698 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:22:27.971107 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-c69ff9fc-e962-48d3-b7d5-d07b46ca4362 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:22:34.107729 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:22:35.123630 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40220. May 28 03:23:35.413785 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:24:27.713362 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:24:28.730698 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40452. May 28 03:24:32.868161 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:24:43.701069 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:24:44.606669 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:24:49.081240 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:24:49.312080 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:24:50.098556 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40504. May 28 03:24:50.328479 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40508. May 28 03:24:51.427526 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:24:52.448311 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40514. May 28 03:24:52.459232 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:24:53.482413 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40520. May 28 03:25:28.890430 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-832a4105-35ad-4529-b899-c1bbf12a8d8a tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:25:28.891143 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-832a4105-35ad-4529-b899-c1bbf12a8d8a tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:25:28.891310 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-832a4105-35ad-4529-b899-c1bbf12a8d8a tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:25:29.129295 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-832a4105-35ad-4529-b899-c1bbf12a8d8a tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: c05a9367-656e-49d8-b247-2ca11d540d56] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98810) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 03:25:29.419099 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-832a4105-35ad-4529-b899-c1bbf12a8d8a tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Created allocations for migration 18497f0b-522f-4447-960b-5e9d5395e8b0 on 396f34e1-470a-4135-acc4-c392f4cd57ff {{(pid=98810) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 03:25:29.425138 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-832a4105-35ad-4529-b899-c1bbf12a8d8a tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [b4b40178-cdfb-419c-9d73-ee49e8fcb117] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 03:25:30.442231 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [None req-832a4105-35ad-4529-b899-c1bbf12a8d8a tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [b4b40178-cdfb-419c-9d73-ee49e8fcb117] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40628. May 28 03:25:32.675018 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-832a4105-35ad-4529-b899-c1bbf12a8d8a tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: c05a9367-656e-49d8-b247-2ca11d540d56] Calling prep_resize with selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [Selection(allocation_request='{"allocations": {"396f34e1-470a-4135-acc4-c392f4cd57ff": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["396f34e1-470a-4135-acc4-c392f4cd57ff"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=18c04405-93e8-4472-a3b7-1e908fd6a496,compute_node_uuid=396f34e1-470a-4135-acc4-c392f4cd57ff,limits=SchedulerLimits,nodename='n-h1-764292-25',service_host='n-h1-764292-25')] {{(pid=98810) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 03:25:32.684753 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-832a4105-35ad-4529-b899-c1bbf12a8d8a tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [6f99272f-03bf-427b-9b3a-b0dee93addbc] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 03:25:33.700455 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [None req-832a4105-35ad-4529-b899-c1bbf12a8d8a tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [6f99272f-03bf-427b-9b3a-b0dee93addbc] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40644. May 28 03:25:35.125497 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:25:36.144263 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40650. May 28 03:25:54.021735 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:25:54.043932 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:25:54.044332 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:25:54.085956 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:25:54.086380 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:25:54.087091 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:25:54.087473 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:25:54.104401 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Getting quotas for project e72e643650ea472c930cbb25eb7430bc. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:25:54.109026 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Getting quotas for user 48b9bba099e841ef9ba84a6e3579135e and project e72e643650ea472c930cbb25eb7430bc. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:25:54.118910 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: d7e2bdff-5945-4e9f-a264-0079ac2cb3d6] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:25:54.119785 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:25:54.120174 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:25:54.126844 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: d7e2bdff-5945-4e9f-a264-0079ac2cb3d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:25:54.128145 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:25:54.128595 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:25:54.155360 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:25:54.155767 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-d8d7bcf3-105e-4eba-b490-577a8c85069f tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:26:55.429727 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:27:50.099753 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:27:50.329884 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:27:51.116569 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40976. May 28 03:27:51.346214 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40980. May 28 03:27:52.444852 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:27:52.885190 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:27:53.467168 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 40988. May 28 03:28:28.731883 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:28:29.748245 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 41060. May 28 03:28:36.143898 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:28:36.500698 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-0d36567b-c96b-4324-a4ae-ef2536fec156 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:28:36.501184 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d36567b-c96b-4324-a4ae-ef2536fec156 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:28:36.501582 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-0d36567b-c96b-4324-a4ae-ef2536fec156 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:28:36.648492 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-0d36567b-c96b-4324-a4ae-ef2536fec156 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: d7e2bdff-5945-4e9f-a264-0079ac2cb3d6] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98809) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 03:28:36.912587 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-0d36567b-c96b-4324-a4ae-ef2536fec156 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Created allocations for migration 84e2b131-897a-43a9-a99f-73e7fcf26936 on 396f34e1-470a-4135-acc4-c392f4cd57ff {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 03:28:37.160240 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 41100. May 28 03:28:39.238275 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-0d36567b-c96b-4324-a4ae-ef2536fec156 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: d7e2bdff-5945-4e9f-a264-0079ac2cb3d6] Calling prep_resize with selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [Selection(allocation_request='{"allocations": {"396f34e1-470a-4135-acc4-c392f4cd57ff": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["396f34e1-470a-4135-acc4-c392f4cd57ff"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=18c04405-93e8-4472-a3b7-1e908fd6a496,compute_node_uuid=396f34e1-470a-4135-acc4-c392f4cd57ff,limits=SchedulerLimits,nodename='n-h1-764292-25',service_host='n-h1-764292-25')] {{(pid=98809) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 03:29:19.336945 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:29:19.360039 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:29:19.360449 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:29:19.401520 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:29:19.401917 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:29:19.402672 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:29:19.403090 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:29:19.418746 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Getting quotas for project e72e643650ea472c930cbb25eb7430bc. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:29:19.423692 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Getting quotas for user 48b9bba099e841ef9ba84a6e3579135e and project e72e643650ea472c930cbb25eb7430bc. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:29:19.433566 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: b82c3f3f-37e0-4406-a0bd-7264d26439f1] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:29:19.434472 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:29:19.434868 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:29:19.440948 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: b82c3f3f-37e0-4406-a0bd-7264d26439f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:29:19.442200 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:29:19.442742 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:29:19.468975 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:29:19.469390 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-031682f6-4d7a-4e4a-a688-4194109183d5 tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:30:15.447307 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:30:51.117709 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:30:52.134798 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 41418. May 28 03:30:53.479896 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:30:54.502761 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 41424. May 28 03:31:12.901527 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:31:23.721700 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:31:24.626029 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:31:29.749379 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:31:30.766695 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 41506. May 28 03:31:37.160738 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:31:38.176758 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 41520. May 28 03:31:51.347883 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:31:52.364089 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 41552. May 28 03:31:53.464037 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:31:54.486059 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 41558. May 28 03:32:19.956350 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-3272b8e4-14c6-4ba5-beb7-70fc9e65663b tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:32:19.956844 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3272b8e4-14c6-4ba5-beb7-70fc9e65663b tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:32:19.957249 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-3272b8e4-14c6-4ba5-beb7-70fc9e65663b tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:32:20.065093 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-3272b8e4-14c6-4ba5-beb7-70fc9e65663b tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: b82c3f3f-37e0-4406-a0bd-7264d26439f1] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98809) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 03:32:20.369611 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-3272b8e4-14c6-4ba5-beb7-70fc9e65663b tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] Created allocations for migration 4e4e2522-f975-4c5a-8017-4cbcaf3cd644 on 1bff8e46-e9c8-450f-8078-657cbe80b915 {{(pid=98809) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 03:32:20.570124 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.tasks.migrate [None req-3272b8e4-14c6-4ba5-beb7-70fc9e65663b tempest-ServerActionsTestJSON-1633385346 tempest-ServerActionsTestJSON-1633385346-project] [instance: b82c3f3f-37e0-4406-a0bd-7264d26439f1] Calling prep_resize with selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [Selection(allocation_request='{"allocations": {"1bff8e46-e9c8-450f-8078-657cbe80b915": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1bff8e46-e9c8-450f-8078-657cbe80b915"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=18c04405-93e8-4472-a3b7-1e908fd6a496,compute_node_uuid=1bff8e46-e9c8-450f-8078-657cbe80b915,limits=SchedulerLimits,nodename='n-h2-764292-25',service_host='n-h2-764292-25')] {{(pid=98809) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 03:32:26.349822 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:32:27.899614 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:33:35.464750 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:33:40.616513 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:33:40.640430 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:40.640842 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:40.690249 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:40.690665 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:40.691386 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:40.692383 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:40.707462 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Getting quotas for project 95fcff03fdeb4d29b4b4942032867014. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:33:40.711825 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Getting quotas for user b6822f04d6a842e2b5ae6a6fcdb55b0d and project 95fcff03fdeb4d29b4b4942032867014. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:33:40.722040 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] [instance: 9d795b33-bef1-41ab-882f-3d7aac81d5de] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:33:40.722960 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:40.723354 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:40.729685 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] [instance: 9d795b33-bef1-41ab-882f-3d7aac81d5de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:33:40.730907 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:40.731300 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:40.759000 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:40.759488 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-be8b9ce6-72bc-4458-b11c-e68109012f65 tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:52.135843 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:33:52.775584 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:33:52.796886 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:52.797296 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:52.840393 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:52.840800 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:52.841531 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:52.841923 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:52.856884 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Getting quotas for project 95fcff03fdeb4d29b4b4942032867014. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:33:52.861252 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Getting quotas for user b6822f04d6a842e2b5ae6a6fcdb55b0d and project 95fcff03fdeb4d29b4b4942032867014. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:33:52.871304 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] [instance: 6a87a031-ab1e-4731-97a5-413c6d48e1b3] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:33:52.872185 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:52.872582 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:52.879131 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] [instance: 6a87a031-ab1e-4731-97a5-413c6d48e1b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:33:52.880557 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:52.880970 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:52.907322 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:33:52.907753 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-9288f845-79f5-4422-97f2-7e7eb3c6176b tempest-ServersNegativeTestJSON-1306285968 tempest-ServersNegativeTestJSON-1306285968-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:33:53.157745 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 41988. May 28 03:34:32.918034 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:34:38.179592 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:34:39.202858 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 42268. May 28 03:34:57.680660 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:34:57.702400 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:34:57.702806 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:34:57.756876 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:34:57.757283 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:34:57.758006 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:34:57.758435 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:34:57.773497 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Getting quotas for project a774ae37960f4eafb30d76c73a4ec64b. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:34:57.777856 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Getting quotas for user 1ed08fc7e5da4a51914579fbc5b33463 and project a774ae37960f4eafb30d76c73a4ec64b. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:34:57.788493 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] [instance: b468460a-22b3-45f6-ac4b-327c3fd0701a] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:34:57.789369 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:34:57.789769 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:34:57.796361 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] [instance: b468460a-22b3-45f6-ac4b-327c3fd0701a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:34:57.797931 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:34:57.798370 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:34:57.824593 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:34:57.824935 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-1ebf17e8-caa3-4e86-b8a1-31f27b8f2d48 tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:35:34.012170 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:35:34.033982 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:35:34.034411 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:35:34.079014 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:35:34.079423 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:35:34.080156 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:35:34.080548 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:35:34.096452 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Getting quotas for project a774ae37960f4eafb30d76c73a4ec64b. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:35:34.100838 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Getting quotas for user 1ed08fc7e5da4a51914579fbc5b33463 and project a774ae37960f4eafb30d76c73a4ec64b. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:35:34.111796 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] [instance: 321eaad6-7e04-4e10-9b12-d12d4143c9ec] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:35:34.112676 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:35:34.113067 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:35:34.119165 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] [instance: 321eaad6-7e04-4e10-9b12-d12d4143c9ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:35:34.120387 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:35:34.120783 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:35:34.147057 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:35:34.147701 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-5b86aafd-d5b7-4839-83bc-42af66c036ed tempest-TestEncryptedCinderVolumes-1152558210 tempest-TestEncryptedCinderVolumes-1152558210-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:36:46.680296 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:36:46.702813 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:36:46.703220 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:36:46.756691 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:36:46.757138 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:36:46.757857 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:36:46.758264 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:36:46.773561 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Getting quotas for project 93307b6a03bb417bb9695b42b5aa0f97. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:36:46.777917 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Getting quotas for user ec30729315b2446686151255f70e50a3 and project 93307b6a03bb417bb9695b42b5aa0f97. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:36:46.788709 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] [instance: 82bf30be-a048-4bed-af51-d880788fc7b3] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:36:46.789603 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:36:46.790003 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:36:46.796112 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] [instance: 82bf30be-a048-4bed-af51-d880788fc7b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ad2e947-6166-4301-a86c-432d43e942d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:36:46.797341 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:36:46.797738 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:36:46.823689 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:36:46.824104 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-0972fd57-c091-4e16-bac6-65c64abbfafe tempest-TestMinimumBasicScenario-1047895377 tempest-TestMinimumBasicScenario-1047895377-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:36:53.156921 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:36:54.173709 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 42896. May 28 03:36:55.483727 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:37:39.200637 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:37:40.217288 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43048. May 28 03:37:52.940974 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:37:54.502002 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:37:55.523980 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43058. May 28 03:38:30.772228 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:38:31.788396 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43096. May 28 03:38:52.369890 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:38:53.387859 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43100. May 28 03:38:54.486683 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:38:55.508676 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43102. May 28 03:39:54.173826 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:39:55.191405 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43350. May 28 03:40:04.116102 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Took 2.53 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:40:04.137806 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:40:04.138214 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:40:04.189642 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:40:04.190040 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:40:04.190793 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:40:04.191181 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:40:04.206200 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Getting quotas for project edb1e9d46e5b4e54a046e5fa874a76a2. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:40:04.210538 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Getting quotas for user 2dc314e904f748caa94f3a247325b70f and project edb1e9d46e5b4e54a046e5fa874a76a2. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:40:04.221447 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: 9f1a7ff2-8d1b-40d7-ace5-17ae96035089] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:40:04.222408 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:40:04.222810 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:40:04.229164 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: 9f1a7ff2-8d1b-40d7-ace5-17ae96035089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:40:04.230359 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:40:04.230765 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:40:04.256668 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:40:04.257092 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-412fc368-47a1-483f-b4d6-54dfe9af5c35 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:40:15.501520 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:40:40.217678 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:40:41.234428 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43466. May 28 03:41:12.958012 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:41:47.341761 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [b4b40178-cdfb-419c-9d73-ee49e8fcb117] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 03:41:48.361051 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [b4b40178-cdfb-419c-9d73-ee49e8fcb117] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43630. May 28 03:41:50.750512 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Took 3.41 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:41:50.767376 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:41:50.767771 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:41:50.810984 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:41:50.811391 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:41:50.812113 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:41:50.812509 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:41:50.827482 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Getting quotas for project edb1e9d46e5b4e54a046e5fa874a76a2. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:41:50.831853 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Getting quotas for user 2dc314e904f748caa94f3a247325b70f and project edb1e9d46e5b4e54a046e5fa874a76a2. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:41:50.842041 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: 5275cdcc-1c0a-466d-8ab2-a4be39557ca2] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:41:50.842957 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:41:50.843362 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:41:50.849602 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: 5275cdcc-1c0a-466d-8ab2-a4be39557ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:41:50.850790 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:41:50.851191 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:41:50.879169 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:41:50.879598 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:41:50.888651 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [6f99272f-03bf-427b-9b3a-b0dee93addbc] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 03:41:51.904780 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [None req-b8c9ada0-8871-4efa-89b6-ff2023364dca tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [6f99272f-03bf-427b-9b3a-b0dee93addbc] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43656. May 28 03:42:31.791338 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:42:32.808993 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43714. May 28 03:42:55.192255 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:42:55.522122 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:42:56.208818 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43730. May 28 03:42:56.543618 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43732. May 28 03:43:03.753717 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:43:04.652264 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:43:35.518580 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:43:41.235903 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:43:42.251838 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43784. May 28 03:43:53.389956 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:43:54.405630 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43788. May 28 03:43:55.508293 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:43:56.530183 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 43790. May 28 03:44:32.974627 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:44:44.186908 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:44:44.210223 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:44:44.210649 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:44:44.259013 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:44:44.259417 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:44:44.260192 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:44:44.260585 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:44:44.278202 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Getting quotas for project edb1e9d46e5b4e54a046e5fa874a76a2. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:44:44.282773 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Getting quotas for user 2dc314e904f748caa94f3a247325b70f and project edb1e9d46e5b4e54a046e5fa874a76a2. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:44:44.294709 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: 67cc59d8-bbdc-49ab-81af-e654035ab678] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:44:44.295659 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:44:44.296063 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:44:44.303836 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: 67cc59d8-bbdc-49ab-81af-e654035ab678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:44:44.305530 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:44:44.306134 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:44:44.340169 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:44:44.340573 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-ba7cf697-de38-4480-8e22-6431ca01c44d tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:45:56.209676 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:45:57.226670 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44004. May 28 03:46:00.616203 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-384cee74-8849-4736-8e17-48bbbaacb499 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method migrate_server {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:46:00.616765 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-384cee74-8849-4736-8e17-48bbbaacb499 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:46:00.617065 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-384cee74-8849-4736-8e17-48bbbaacb499 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:46:00.829212 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-384cee74-8849-4736-8e17-48bbbaacb499 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: 67cc59d8-bbdc-49ab-81af-e654035ab678] Restricting to cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) while migrating {{(pid=98810) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 28 03:46:01.142992 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-384cee74-8849-4736-8e17-48bbbaacb499 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Created allocations for migration 77c0fe43-5eff-4088-9fa2-7a606bbcfe85 on 396f34e1-470a-4135-acc4-c392f4cd57ff {{(pid=98810) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 28 03:46:01.347853 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.tasks.migrate [None req-384cee74-8849-4736-8e17-48bbbaacb499 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: 67cc59d8-bbdc-49ab-81af-e654035ab678] Calling prep_resize with selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [Selection(allocation_request='{"allocations": {"396f34e1-470a-4135-acc4-c392f4cd57ff": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["396f34e1-470a-4135-acc4-c392f4cd57ff"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=18c04405-93e8-4472-a3b7-1e908fd6a496,compute_node_uuid=396f34e1-470a-4135-acc4-c392f4cd57ff,limits=SchedulerLimits,nodename='n-h1-764292-25',service_host='n-h1-764292-25')] {{(pid=98810) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 28 03:46:42.258866 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:46:43.275211 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44092. May 28 03:46:55.535010 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:46:56.540755 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:46:57.561676 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44104. May 28 03:47:30.969539 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:47:30.991412 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:47:30.992075 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:47:31.035371 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:47:31.036182 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:47:31.036913 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:47:31.037305 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:47:31.052770 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Getting quotas for project edb1e9d46e5b4e54a046e5fa874a76a2. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:47:31.057401 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Getting quotas for user 2dc314e904f748caa94f3a247325b70f and project edb1e9d46e5b4e54a046e5fa874a76a2. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:47:31.068283 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: 2f822a60-923c-4c10-951d-c0adc36facc6] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:47:31.069723 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:47:31.069863 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:47:31.076041 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: 2f822a60-923c-4c10-951d-c0adc36facc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:47:31.077877 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:47:31.078429 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:47:31.103909 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:47:31.104349 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e0654368-bc9b-48a7-bbd5-f85b68c65942 tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:47:32.813791 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:47:33.834975 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44260. May 28 03:47:52.998042 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:48:03.773179 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:48:57.228173 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:48:58.245254 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44332. May 28 03:49:43.275995 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:49:44.292095 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44380. May 28 03:49:44.671794 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:49:54.411348 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:49:55.427744 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44396. May 28 03:49:56.528893 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:49:57.553244 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44400. May 28 03:49:57.557855 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:49:58.578975 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44402. May 28 03:50:15.551519 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:50:23.508896 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [b4b40178-cdfb-419c-9d73-ee49e8fcb117] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 03:50:24.527713 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [b4b40178-cdfb-419c-9d73-ee49e8fcb117] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44526. May 28 03:50:26.788100 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Took 3.29 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:50:26.809893 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:50:26.810327 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:50:26.855343 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:50:26.855747 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:50:26.856479 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:50:26.856869 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:50:26.872496 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Getting quotas for project edb1e9d46e5b4e54a046e5fa874a76a2. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:50:26.876835 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Getting quotas for user 2dc314e904f748caa94f3a247325b70f and project edb1e9d46e5b4e54a046e5fa874a76a2. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:50:26.887507 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: a59ac428-3818-4653-9af9-a640771af28b] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:50:26.888426 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:50:26.888824 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:50:26.896721 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [instance: a59ac428-3818-4653-9af9-a640771af28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:50:26.898056 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:50:26.898496 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:50:26.926940 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:50:26.927337 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:50:26.936202 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [6f99272f-03bf-427b-9b3a-b0dee93addbc] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 03:50:27.951279 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [None req-f15d5587-bee4-48f4-aaac-71ecaaba04ea tempest-TestNetworkAdvancedServerOps-1315004044 tempest-TestNetworkAdvancedServerOps-1315004044-project] [6f99272f-03bf-427b-9b3a-b0dee93addbc] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44548. May 28 03:50:33.836799 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:50:34.854555 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44564. May 28 03:51:13.014667 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:51:23.790085 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:51:58.246950 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:51:59.262588 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44680. May 28 03:52:23.266072 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:52:23.287796 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:52:23.288196 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:52:23.337886 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:52:23.338297 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:52:23.339023 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:52:23.339408 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:52:23.354624 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Getting quotas for project 25b28f76be88429db4f8ebc6c38e62a9. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:52:23.359029 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Getting quotas for user 06087cbfbcaa4ee1ba8c65693432c0a2 and project 25b28f76be88429db4f8ebc6c38e62a9. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:52:23.369941 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] [instance: b85c27e1-1dd7-4408-8577-3c98ce351f73] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:52:23.370851 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:52:23.371255 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:52:23.377581 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] [instance: b85c27e1-1dd7-4408-8577-3c98ce351f73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:52:23.378861 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:52:23.379257 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:52:23.404830 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:52:23.405201 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-74931ca3-ba02-4a55-884b-1444623f6db8 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:52:44.292742 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:52:45.309024 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44908. May 28 03:52:55.427925 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:52:56.444084 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44916. May 28 03:52:57.547149 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:52:58.585159 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44920. May 28 03:53:35.567512 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:54:33.030751 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:54:34.856908 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:54:35.888393 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44940. May 28 03:54:43.806804 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:54:44.690675 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:54:58.579144 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:54:59.264486 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:54:59.601243 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44948. May 28 03:55:00.280306 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 44950. May 28 03:55:31.757978 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e93b2c4e-8aae-4b13-9d17-a957bc578b45 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method unshelve_instance {{(pid=98810) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 03:55:31.758640 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e93b2c4e-8aae-4b13-9d17-a957bc578b45 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:55:31.758883 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-e93b2c4e-8aae-4b13-9d17-a957bc578b45 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:55:32.096616 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e93b2c4e-8aae-4b13-9d17-a957bc578b45 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] [instance: b85c27e1-1dd7-4408-8577-3c98ce351f73] Requesting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) during scheduling {{(pid=98810) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 28 03:55:32.105746 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e93b2c4e-8aae-4b13-9d17-a957bc578b45 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] [b4b40178-cdfb-419c-9d73-ee49e8fcb117] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 03:55:33.122916 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [None req-e93b2c4e-8aae-4b13-9d17-a957bc578b45 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] [b4b40178-cdfb-419c-9d73-ee49e8fcb117] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45098. May 28 03:55:35.458699 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-e93b2c4e-8aae-4b13-9d17-a957bc578b45 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Took 3.36 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:55:35.468005 n-d-764292-25 nova-conductor[98810]: DEBUG nova.objects.instance [None req-e93b2c4e-8aae-4b13-9d17-a957bc578b45 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lazy-loading 'flavor' on Instance uuid b85c27e1-1dd7-4408-8577-3c98ce351f73 {{(pid=98810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 03:55:35.515096 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e93b2c4e-8aae-4b13-9d17-a957bc578b45 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] [6f99272f-03bf-427b-9b3a-b0dee93addbc] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 03:55:36.531387 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [None req-e93b2c4e-8aae-4b13-9d17-a957bc578b45 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] [6f99272f-03bf-427b-9b3a-b0dee93addbc] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45118. May 28 03:55:45.309927 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:55:46.327460 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45162. May 28 03:56:55.584418 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:57:35.890025 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:57:36.907300 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45258. May 28 03:57:53.046936 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:57:56.447648 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:57:57.465644 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45398. May 28 03:57:58.584111 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:57:59.598712 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 03:57:59.611065 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45404. May 28 03:58:00.282855 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:58:00.622004 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45408. May 28 03:58:01.301122 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45412. May 28 03:58:03.822972 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:58:04.706327 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 03:58:12.221784 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Took 0.19 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 03:58:12.243903 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:58:12.244332 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:58:12.285254 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:58:12.285659 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:58:12.286421 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:58:12.286812 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:58:12.302100 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Getting quotas for project 25b28f76be88429db4f8ebc6c38e62a9. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 03:58:12.306409 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Getting quotas for user 06087cbfbcaa4ee1ba8c65693432c0a2 and project 25b28f76be88429db4f8ebc6c38e62a9. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 03:58:12.317071 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] [instance: d88cf179-a670-480b-bf32-8792bb70fe8f] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 03:58:12.318030 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:58:12.318493 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:58:12.324771 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] [instance: d88cf179-a670-480b-bf32-8792bb70fe8f] block_device_mapping [BlockDeviceMapping(attachment_id=e850ef5f-7a07-4a9c-ac74-8517a771adda,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fc7fb67-17ea-47e8-bd87-a4d8f592892e',volume_size=1,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 03:58:12.325895 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:58:12.326332 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:58:12.354252 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 03:58:12.354689 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-a6c662e0-eede-40bf-ab2f-5c8afbf420e3 tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 03:58:46.328560 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 03:58:47.345307 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45552. May 28 04:00:15.601567 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:00:36.907113 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:00:37.922540 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45596. May 28 04:00:42.137246 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-f9ea2e42-9e5d-415d-9867-2392b278ec8b tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Targeting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) for conductor method unshelve_instance {{(pid=98809) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 28 04:00:42.137800 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f9ea2e42-9e5d-415d-9867-2392b278ec8b tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:00:42.138120 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-f9ea2e42-9e5d-415d-9867-2392b278ec8b tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:00:42.503695 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-f9ea2e42-9e5d-415d-9867-2392b278ec8b tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] [instance: d88cf179-a670-480b-bf32-8792bb70fe8f] Requesting cell 18c04405-93e8-4472-a3b7-1e908fd6a496(cell1) during scheduling {{(pid=98809) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 28 04:00:44.832017 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-f9ea2e42-9e5d-415d-9867-2392b278ec8b tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Took 2.32 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 04:00:44.840771 n-d-764292-25 nova-conductor[98809]: DEBUG nova.objects.instance [None req-f9ea2e42-9e5d-415d-9867-2392b278ec8b tempest-TestShelveInstance-808398001 tempest-TestShelveInstance-808398001-project] Lazy-loading 'flavor' on Instance uuid d88cf179-a670-480b-bf32-8792bb70fe8f {{(pid=98809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 28 04:00:46.392520 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:00:47.947266 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:00:57.466025 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:00:58.483348 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45674. May 28 04:00:59.605240 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:01:00.627256 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45678. May 28 04:01:01.301864 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:01:02.318343 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45684. May 28 04:01:13.065771 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:01:47.345801 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:01:48.361608 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45708. May 28 04:02:59.164308 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=98809) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 04:02:59.188252 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:02:59.188683 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:02:59.242907 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:02:59.243311 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:02:59.244035 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:02:59.244667 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:02:59.260290 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Getting quotas for project ead903b6f4b44a43a02eb0718ad27e99. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 04:02:59.264686 n-d-764292-25 nova-conductor[98809]: DEBUG nova.quota [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Getting quotas for user d2e930f498274fe2abcd199a89bc16c6 and project ead903b6f4b44a43a02eb0718ad27e99. Resources: {'cores', 'instances', 'ram'} {{(pid=98809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 04:02:59.275439 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] [instance: 66ed5bcb-d050-4db5-945d-ddf933edf699] Selected host: n-h2-764292-25; Selected node: n-h2-764292-25; Alternates: [('n-h1-764292-25', 'n-h1-764292-25')] {{(pid=98809) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 04:02:59.276384 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:02:59.276787 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:02:59.284317 n-d-764292-25 nova-conductor[98809]: DEBUG nova.conductor.manager [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] [instance: 66ed5bcb-d050-4db5-945d-ddf933edf699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0ffab94-10e6-4122-b37c-1755fdadc271',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98809) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 04:02:59.285574 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:02:59.285983 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:02:59.315280 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:02:59.315714 n-d-764292-25 nova-conductor[98809]: DEBUG oslo_concurrency.lockutils [None req-45443ebc-caa8-488c-aae6-50c65a962ac9 tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:03:35.618571 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:03:58.483497 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:03:59.498739 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45994. May 28 04:04:00.624300 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:04:01.647746 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45998. May 28 04:04:02.319764 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:04:03.335391 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46000. May 28 04:04:06.410349 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:04:07.963930 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:04:33.085315 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:04:48.363896 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:04:49.380891 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46016. May 28 04:05:00.621053 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:05:01.642811 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46020. May 28 04:05:37.925860 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:05:38.942423 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46022. May 28 04:05:59.846585 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=98810) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 28 04:05:59.868247 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:05:59.868660 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:05:59.927509 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:05:59.927831 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:05:59.928548 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:05:59.928931 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:05:59.944189 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Getting quotas for project ead903b6f4b44a43a02eb0718ad27e99. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 28 04:05:59.948556 n-d-764292-25 nova-conductor[98810]: DEBUG nova.quota [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Getting quotas for user d2e930f498274fe2abcd199a89bc16c6 and project ead903b6f4b44a43a02eb0718ad27e99. Resources: {'cores', 'instances', 'ram'} {{(pid=98810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 28 04:05:59.959100 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] [instance: fb3753fc-0de6-4fa8-8149-62b9e0011866] Selected host: n-h1-764292-25; Selected node: n-h1-764292-25; Alternates: [('n-h2-764292-25', 'n-h2-764292-25')] {{(pid=98810) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 28 04:05:59.960023 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:05:59.960429 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:05:59.967129 n-d-764292-25 nova-conductor[98810]: DEBUG nova.conductor.manager [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] [instance: fb3753fc-0de6-4fa8-8149-62b9e0011866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2398b8de-ab4a-46b7-93aa-74a4eeb464c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98810) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 28 04:05:59.968364 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:05:59.968768 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:05:59.995127 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 28 04:05:59.995526 n-d-764292-25 nova-conductor[98810]: DEBUG oslo_concurrency.lockutils [None req-429530eb-5aca-430b-9013-2d54b60eb8fa tempest-TestSnapshotPattern-1906937651 tempest-TestSnapshotPattern-1906937651-project] Lock "18c04405-93e8-4472-a3b7-1e908fd6a496" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 28 04:06:55.634763 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:07:03.337391 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:07:04.353136 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46316. May 28 04:07:49.382187 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:07:50.399010 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46334. May 28 04:07:53.101936 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:08:01.639012 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:08:01.644750 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:08:02.663932 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46346. May 28 04:08:02.668058 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46348. May 28 04:08:03.848223 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:08:04.728739 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:08:38.942955 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:08:39.959501 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46354. May 28 04:08:59.503457 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:09:00.519384 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46548. May 28 04:09:06.427657 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:09:07.981764 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:10:04.355479 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:10:05.372131 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46718. May 28 04:10:15.651991 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:10:50.399745 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:10:51.416466 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46724. May 28 04:11:02.657409 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:11:02.662823 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:11:03.682513 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46732. May 28 04:11:03.687838 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46734. May 28 04:11:13.118747 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:11:23.865155 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:11:24.745485 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:11:39.962021 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:11:40.978413 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46750. May 28 04:12:00.520877 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:12:01.536508 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46760. May 28 04:12:26.444286 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:12:28.001062 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:13:05.372660 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:13:06.388322 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46788. May 28 04:13:35.668819 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:13:51.417617 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:13:52.433631 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46792. May 28 04:14:03.675584 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:14:03.685958 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:14:04.696928 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46794. May 28 04:14:04.713979 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46796. May 28 04:14:33.134918 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:14:40.978811 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:14:41.995858 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46806. May 28 04:14:43.880839 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:14:44.761741 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:15:01.537871 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:15:02.553513 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [928abbea-1921-41a8-a00e-8b0447ab361c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46816. May 28 04:15:46.464235 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:15:48.018142 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:16:06.388627 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:16:07.404920 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [65976c9b-025c-4117-a6af-ef6ca7d08d36] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46844. May 28 04:16:52.434634 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:16:53.451992 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [4816d206-94ff-4dbf-aa7d-2993b875d1b0] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46846. May 28 04:16:55.689242 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 04:17:04.691893 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:17:04.709455 n-d-764292-25 nova-conductor[98810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] AMQP server on 10.222.0.24:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 28 04:17:05.713432 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [a18c6125-8654-4423-be81-63e4e075d2e3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46850. May 28 04:17:05.730898 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] [1decaf6c-248b-4e01-b78b-383286f12ea2] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46852. May 28 04:17:41.997264 n-d-764292-25 nova-conductor[98809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 04:17:43.013454 n-d-764292-25 nova-conductor[98809]: INFO oslo.messaging._drivers.impl_rabbit [-] [d39dff6f-22e1-43c1-8e61-4cd242f47c2d] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 46860. May 28 04:17:53.151528 n-d-764292-25 nova-conductor[98810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer