-- Logs begin at Thu 2021-06-10 01:35:29 UTC, end at Thu 2021-06-10 04:41:40 UTC. -- Jun 10 02:22:29.638190 n-d-779913-11 systemd[1]: Started Devstack devstack@n-super-cond.service. Jun 10 02:22:33.178906 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_db.sqlalchemy.engines [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 02:22:33.403801 n-d-779913-11 nova-conductor[98426]: DEBUG nova.context [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) {{(pid=98426) load_cells /opt/stack/nova/nova/context.py:464}} Jun 10 02:22:33.407192 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_concurrency.lockutils [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:22:33.408693 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_concurrency.lockutils [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:22:33.409547 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_concurrency.lockutils [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:22:33.411257 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_concurrency.lockutils [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:22:33.443592 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_db.sqlalchemy.engines [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 02:22:33.444751 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_db.sqlalchemy.engines [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 02:22:33.461935 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_concurrency.lockutils [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Acquired lock "singleton_lock" {{(pid=98426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jun 10 02:22:33.462996 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_concurrency.lockutils [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Releasing lock "singleton_lock" {{(pid=98426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jun 10 02:22:33.465708 n-d-779913-11 nova-conductor[98426]: INFO oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Starting 2 workers Jun 10 02:22:33.470472 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Started child 99293 {{(pid=98426) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Jun 10 02:22:33.476515 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Started child 99294 {{(pid=98426) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Jun 10 02:22:33.478104 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Full set of CONF: {{(pid=98426) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Jun 10 02:22:33.478411 n-d-779913-11 nova-conductor[99293]: INFO nova.service [-] Starting conductor node (version 23.1.0) Jun 10 02:22:33.478975 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ******************************************************************************** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 10 02:22:33.479413 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] Configuration options gathered from: {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 10 02:22:33.481673 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 10 02:22:33.482486 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] config files: ['/etc/nova/nova.conf'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 10 02:22:33.482899 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ================================================================================ {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 10 02:22:33.483817 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] allow_resize_to_same_host = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.484390 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] arq_binding_timeout = 300 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.484936 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] block_device_allocate_retries = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.485670 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] block_device_allocate_retries_interval = 3 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.486469 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cert = self.pem {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.487036 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute_driver = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.487836 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute_monitors = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.488533 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] config_dir = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.489281 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] config_drive_format = iso9660 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.489768 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] config_file = ['/etc/nova/nova.conf'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.490297 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] config_source = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.490925 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] console_host = n-d-779913-11 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.491529 n-d-779913-11 nova-conductor[99294]: INFO nova.service [-] Starting conductor node (version 23.1.0) Jun 10 02:22:33.499064 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] control_exchange = nova {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499064 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cpu_allocation_ratio = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499064 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] daemon = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499064 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] debug = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499064 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] default_access_ip_network_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499064 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] default_availability_zone = nova {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499064 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] default_ephemeral_format = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499614 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499614 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] default_schedule_zone = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499614 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] disk_allocation_ratio = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499614 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] enable_new_services = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.499614 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] enabled_apis = ['osapi_compute'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.500051 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] enabled_ssl_apis = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.500704 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] flat_injected = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.505163 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] force_config_drive = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.505163 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] force_raw_images = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.505163 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] graceful_shutdown_timeout = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.505163 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] heal_instance_info_cache_interval = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.505163 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] host = n-d-779913-11 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.505163 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] initial_cpu_allocation_ratio = 16.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.505163 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] initial_disk_allocation_ratio = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.505789 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] initial_ram_allocation_ratio = 1.5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.506348 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.507099 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] instance_build_timeout = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.509487 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] instance_delete_interval = 300 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.509487 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] instance_format = [instance: %(uuid)s] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.509487 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] instance_name_template = instance-%08x {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.509487 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] instance_usage_audit = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.510072 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] instance_usage_audit_period = month {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.510634 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.511212 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] instances_path = /opt/stack/data/nova/instances {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.511721 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] internal_service_availability_zone = internal {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.512203 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] key = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.512680 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] live_migration_retry_count = 30 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.513907 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] log_config_append = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.513907 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.514100 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] log_dir = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.514565 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] log_file = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.515046 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] log_options = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.515581 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] log_rotate_interval = 1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.516099 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] log_rotate_interval_type = days {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.517281 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] log_rotation_type = none {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.517713 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.518315 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.518829 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.519486 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.519898 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.520421 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] long_rpc_timeout = 1800 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.520997 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] max_concurrent_builds = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.521394 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] max_concurrent_live_migrations = 1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.521866 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] max_concurrent_snapshots = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.522337 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] max_local_block_devices = 3 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.522902 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] max_logfile_count = 30 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.523306 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] max_logfile_size_mb = 200 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.523785 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] maximum_instance_delete_attempts = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.526207 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] metadata_listen = 0.0.0.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.526207 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] metadata_listen_port = 8775 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.527715 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_db.sqlalchemy.engines [None req-5f25ae89-eed7-45cb-b4fd-5bcbcaef320e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 02:22:33.529915 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] metadata_workers = 2 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.532045 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] migrate_max_retries = -1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.533419 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] mkisofs_cmd = genisoimage {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.534121 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] my_block_storage_ip = 10.222.0.49 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.534669 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] my_ip = 10.222.0.49 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.536041 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] network_allocate_retries = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.536549 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.537024 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] osapi_compute_listen = 0.0.0.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.537596 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] osapi_compute_listen_port = 8774 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.538107 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] osapi_compute_unique_server_name_scope = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.538978 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] osapi_compute_workers = 2 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.539975 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] password_length = 12 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.540643 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] periodic_enable = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.543345 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] periodic_fuzzy_delay = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.544090 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] pointer_model = usbtablet {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.544203 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_db.sqlalchemy.engines [None req-aae983c6-970b-47e9-a0b8-e02608bf96ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 02:22:33.544719 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] preallocate_images = none {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.545185 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] publish_errors = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.545781 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] pybasedir = /opt/stack/nova {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.546340 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ram_allocation_ratio = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.546823 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] rate_limit_burst = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.547452 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] rate_limit_except_level = CRITICAL {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.555587 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] rate_limit_interval = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.555587 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] reboot_timeout = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.555587 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] reclaim_instance_interval = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.555587 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] record = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.555587 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] report_interval = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.555587 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] rescue_timeout = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.555587 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] reserved_host_cpus = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556114 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] reserved_host_disk_mb = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556114 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] reserved_host_memory_mb = 512 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556114 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] reserved_huge_pages = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556114 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] resize_confirm_window = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556114 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] resize_fs_using_block_device = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556114 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] resume_guests_state_on_host_boot = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556114 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556516 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] rpc_response_timeout = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556516 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] run_external_periodic_tasks = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556516 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] running_deleted_instance_action = reap {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556516 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] running_deleted_instance_poll_interval = 1800 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556516 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] running_deleted_instance_timeout = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556516 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler_instance_sync_interval = 120 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.556875 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_down_time = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.557517 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] servicegroup_driver = db {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.557966 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] shelved_offload_time = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.558644 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] shelved_poll_interval = 3600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.559203 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] shutdown_timeout = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.559644 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] source_is_ipv6 = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.560418 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ssl_only = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.560892 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] state_path = /opt/stack/data/nova {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.561339 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] sync_power_state_interval = 600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.561783 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] sync_power_state_pool_size = 1000 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.562240 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] syslog_log_facility = LOG_USER {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.562684 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] tempdir = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.563173 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] timeout_nbd = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.563740 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] transport_url = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.564264 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] update_resources_interval = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.564882 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] use_cow_images = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.565575 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] use_eventlog = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.565680 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] use_journal = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.566130 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] use_json = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.566592 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] use_rootwrap_daemon = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.567530 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] use_stderr = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.567971 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] use_syslog = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.568364 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vcpu_pin_set = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.568783 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vif_plugging_is_fatal = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.569465 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vif_plugging_timeout = 300 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.570284 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] virt_mkfs = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.570676 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] volume_usage_poll_interval = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.571149 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] watch_log_file = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.571577 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] web = /usr/share/spice-html5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 02:22:33.572155 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_concurrency.disable_process_locking = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.572849 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.573501 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.auth_strategy = keystone {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.574758 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.compute_link_prefix = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.575229 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.575691 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.dhcp_domain = novalocal {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.576087 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.enable_instance_password = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.576526 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.glance_link_prefix = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.576920 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.577339 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.instance_list_cells_batch_strategy = distributed {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.577905 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.instance_list_per_project_cells = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.578298 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.list_records_by_skipping_down_cells = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.578742 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.local_metadata_per_cell = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.580907 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.max_limit = 1000 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.581342 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.metadata_cache_expiration = 15 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.581753 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.neutron_default_tenant_id = default {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.582177 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.use_forwarded_for = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.582572 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.use_neutron_default_nets = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.583176 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.583694 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.vendordata_dynamic_failure_fatal = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.584097 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.584501 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.vendordata_dynamic_ssl_certfile = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.584897 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.vendordata_dynamic_targets = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.590780 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.vendordata_jsonfile_path = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.590780 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api.vendordata_providers = ['StaticJSON'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.590780 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.backend = dogpile.cache.memcached {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.590780 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.backend_argument = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.590780 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.config_prefix = cache.oslo {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.590780 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.debug_cache_backend = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.590780 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.enabled = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.591358 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.expiration_time = 600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.591358 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.memcache_dead_retry = 300 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.591358 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.591358 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.591358 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.memcache_pool_maxsize = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.591358 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.591358 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.591822 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.memcache_socket_timeout = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.591822 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.proxies = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.592226 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.tls_allowed_ciphers = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.592619 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.tls_cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.593045 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.tls_certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.593425 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.tls_enabled = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.593861 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cache.tls_keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.594587 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.auth_section = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.595609 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.auth_type = password {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.595996 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.596529 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.catalog_info = volumev3::publicURL {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.596940 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.597290 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.597691 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.cross_az_attach = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.598086 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.endpoint_template = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.598514 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.http_retries = 3 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.598900 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.599356 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.599746 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.os_region_name = RegionOne {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.600295 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.600989 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cinder.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.601409 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.601788 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute.cpu_dedicated_set = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.602227 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute.cpu_shared_set = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.602658 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute.image_type_exclude_list = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.604758 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute.live_migration_wait_for_vif_plug = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.604758 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute.max_concurrent_disk_ops = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.604758 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute.max_disk_devices_to_attach = -1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.604758 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.604758 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute.resource_provider_association_refresh = 300 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.605465 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] compute.shutdown_retry_interval = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.605465 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] conductor.workers = 2 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.605833 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] console.allowed_origins = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.606377 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] console.ssl_ciphers = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.606830 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] console.ssl_minimum_version = default {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.607259 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] consoleauth.token_ttl = 600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.607682 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.608072 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.608470 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.608840 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.connect_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.609244 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.connect_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.609706 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.endpoint_override = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.610038 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.610436 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.611153 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.max_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.611533 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.min_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.611905 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.region_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.612274 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.service_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.612671 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.service_type = accelerator {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.613042 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.613408 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.status_code_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.613786 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.status_code_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.614156 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.614586 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.615038 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] cyborg.version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.615545 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.connection = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.619438 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.connection_debug = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.619438 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.connection_parameters = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.619438 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.connection_recycle_time = 3600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.619438 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.connection_trace = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.619438 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.max_overflow = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.619438 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.max_pool_size = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.619438 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.max_retries = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.620386 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.620386 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.pool_timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.620386 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.retry_interval = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.620386 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.slave_connection = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.620386 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] api_database.sqlite_synchronous = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.621052 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] devices.enabled_vgpu_types = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.621237 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.621566 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ephemeral_storage_encryption.enabled = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.621950 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ephemeral_storage_encryption.key_size = 512 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.622371 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.api_servers = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.622813 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.623169 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.623521 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.623914 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.connect_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.624283 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.connect_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.624675 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.debug = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.625058 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.default_trusted_certificate_ids = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.625433 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.enable_certificate_validation = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.625907 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.enable_rbd_download = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.626458 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.endpoint_override = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.626890 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.627301 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.627680 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.max_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.628049 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.min_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.628430 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.num_retries = 3 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.628819 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.rbd_ceph_conf = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.629192 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.rbd_connect_timeout = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.629580 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.rbd_pool = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.629974 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.rbd_user = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.630342 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.region_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.630714 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.service_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.631383 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.service_type = image {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.631760 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.632125 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.status_code_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.632493 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.status_code_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.632975 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.633366 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.633661 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.verify_glance_signatures = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.634028 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] glance.version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.634426 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] guestfs.debug = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.634859 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.config_drive_cdrom = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.635299 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.config_drive_inject_password = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.635690 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.636075 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.enable_instance_metrics_collection = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.636450 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.enable_remotefx = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.636842 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.instances_path_share = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.637220 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.iscsi_initiator_list = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.637696 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.limit_cpu_features = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.637976 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.639204 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.639204 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.power_state_check_timeframe = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.639528 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.power_state_event_polling_interval = 2 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.640359 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.640359 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.use_multipath_io = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.640652 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.volume_attach_retry_count = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.640809 n-d-779913-11 nova-conductor[99293]: DEBUG nova.service [None req-5f25ae89-eed7-45cb-b4fd-5bcbcaef320e None None] Creating RPC server for service conductor {{(pid=99293) start /opt/stack/nova/nova/service.py:182}} Jun 10 02:22:33.641348 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.volume_attach_retry_interval = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.642241 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.vswitch_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.642680 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.643143 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] mks.enabled = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.644301 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.644764 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] image_cache.manager_interval = 2400 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.645198 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] image_cache.precache_concurrency = 1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.645589 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] image_cache.remove_unused_base_images = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.646023 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.646455 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.646915 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] image_cache.subdirectory_name = _base {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.647354 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.api_max_retries = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.653980 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.api_retry_interval = 2 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.653980 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.auth_section = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.653980 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.auth_type = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.653980 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.653980 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.653980 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.653980 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.connect_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654471 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.connect_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654471 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.endpoint_override = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654471 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654471 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654471 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.max_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654471 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.min_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654471 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.partition_key = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654882 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.peer_list = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654882 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.region_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654882 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.serial_console_state_timeout = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.654882 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.service_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.655162 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.service_type = baremetal {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.655529 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.655898 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.status_code_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.656355 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.status_code_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.656728 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.657181 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.658125 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ironic.version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.658667 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.659120 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] key_manager.fixed_key = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.659598 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.659983 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.barbican_api_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.660384 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.barbican_endpoint = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.661061 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.barbican_endpoint_type = public {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.661671 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.barbican_region_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.662070 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.662448 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.662880 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.663337 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.663716 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.664099 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.number_of_retries = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.664501 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.retry_delay = 1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.664878 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.665340 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.665720 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.verify_ssl = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.666113 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] barbican.verify_ssl_path = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.666523 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.approle_role_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.666983 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.approle_secret_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.667417 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.667795 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.668171 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.668550 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.668920 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.670887 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.kv_mountpoint = secret {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.671429 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.kv_version = 2 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.671832 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.root_token_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.672241 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.672630 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.ssl_ca_crt_file = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.673235 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.674419 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.use_ssl = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.674721 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.675163 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.675699 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.675940 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.676356 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.connect_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.676745 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.connect_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.677408 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.endpoint_override = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.677514 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.677895 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.678267 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.max_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.678649 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.min_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.680373 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.region_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.680483 n-d-779913-11 nova-conductor[99294]: DEBUG nova.service [None req-aae983c6-970b-47e9-a0b8-e02608bf96ff None None] Creating RPC server for service conductor {{(pid=99294) start /opt/stack/nova/nova/service.py:182}} Jun 10 02:22:33.680582 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.service_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.682177 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.service_type = identity {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.682177 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.682177 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.status_code_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.684024 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.status_code_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.685818 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.685818 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.685818 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] keystone.version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.686137 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.connection_uri = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.686714 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.cpu_mode = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.687699 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.cpu_model_extra_flags = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.688340 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.cpu_models = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.690412 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.device_detach_attempts = 8 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.691009 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.device_detach_timeout = 20 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.691581 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.disk_cachemodes = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.692496 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.disk_prefix = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.693073 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.enabled_perf_events = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.693626 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.file_backed_memory = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.694189 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.gid_maps = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.695376 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.hw_disk_discard = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.696310 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.hw_machine_type = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.696889 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.images_rbd_ceph_conf = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.697453 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.698388 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.698976 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.images_rbd_glance_store_name = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.700774 n-d-779913-11 nova-conductor[99293]: DEBUG nova.service [None req-5f25ae89-eed7-45cb-b4fd-5bcbcaef320e None None] Join ServiceGroup membership for this service conductor {{(pid=99293) start /opt/stack/nova/nova/service.py:199}} Jun 10 02:22:33.701279 n-d-779913-11 nova-conductor[99293]: DEBUG nova.servicegroup.drivers.db [None req-5f25ae89-eed7-45cb-b4fd-5bcbcaef320e None None] DB_Driver: join new ServiceGroup member n-d-779913-11 to the conductor group, service = {{(pid=99293) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jun 10 02:22:33.703139 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.images_rbd_pool = rbd {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.703593 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.images_type = default {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.704856 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.images_volume_group = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.705030 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.inject_key = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.705802 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.inject_partition = -2 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.705802 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.inject_password = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.706224 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.iscsi_iface = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.706621 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.iser_use_multipath = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.707042 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_bandwidth = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.707440 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_completion_timeout = 800 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.707831 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_downtime = 500 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.708230 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_downtime_delay = 75 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.708618 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_downtime_steps = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.709012 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_inbound_addr = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.709405 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_permit_auto_converge = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.709810 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_permit_post_copy = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.710181 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_scheme = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.710593 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_timeout_action = abort {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.713521 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_tunnelled = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.713521 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_uri = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.713521 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.live_migration_with_native_tls = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.713521 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.max_queues = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.713521 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.mem_stats_period_seconds = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.713521 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.nfs_mount_options = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.713521 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.714013 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.num_aoe_discover_tries = 3 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.714200 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.num_iser_scan_tries = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.714802 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.num_memory_encrypted_guests = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.715422 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.num_nvme_discover_tries = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.715997 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.num_pcie_ports = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.716589 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.num_volume_scan_tries = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.717169 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.pmem_namespaces = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.717760 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.quobyte_client_cfg = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.718438 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.719305 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.rbd_connect_timeout = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.719961 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.720533 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.721126 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.rbd_secret_uuid = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.721711 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.rbd_user = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.722111 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.realtime_scheduler_priority = 1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.722531 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.remote_filesystem_transport = ssh {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.722924 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.rescue_image_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.723330 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.rescue_kernel_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.723718 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.rescue_ramdisk_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.724132 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.rng_dev_path = /dev/urandom {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.724516 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.rx_queue_size = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.724931 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.smbfs_mount_options = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.725439 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.725843 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.snapshot_compression = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.726230 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.snapshot_image_format = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.726743 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.727156 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.sparse_logical_volumes = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.727547 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.swtpm_enabled = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.727946 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.swtpm_group = tss {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.728373 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.swtpm_user = tss {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.728786 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.sysinfo_serial = unique {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.729173 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.tx_queue_size = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.729568 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.uid_maps = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.729956 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.use_virtio_for_bridges = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.730361 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.virt_type = kvm {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.730758 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.volume_clear = zero {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.731173 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.volume_clear_size = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.731577 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.volume_use_multipath = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.731951 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.vzstorage_cache_path = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.732526 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.732930 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.vzstorage_mount_group = qemu {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.733322 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.vzstorage_mount_opts = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.733731 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.734228 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.734641 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.vzstorage_mount_user = stack {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.735078 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.735549 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.auth_section = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.736143 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.auth_type = password {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.736680 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.737220 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.737612 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.737995 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.connect_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.738448 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.connect_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.738855 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.default_floating_pool = public {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.739409 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.endpoint_override = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.739804 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.extension_sync_interval = 600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.740202 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.http_retries = 3 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.740588 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.740978 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.741362 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.max_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.741767 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.metadata_proxy_shared_secret = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.742153 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.min_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.742553 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.ovs_bridge = br-int {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.742962 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.physnets = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.743376 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.region_name = RegionOne {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.743771 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.service_metadata_proxy = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.744162 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.service_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.744567 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.service_type = network {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.744957 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.745354 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.status_code_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.745736 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.status_code_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.746229 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.746655 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.747080 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] neutron.version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.747483 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] notifications.bdms_in_notifications = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.747892 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] notifications.default_level = INFO {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.748288 n-d-779913-11 nova-conductor[99294]: DEBUG nova.service [None req-aae983c6-970b-47e9-a0b8-e02608bf96ff None None] Join ServiceGroup membership for this service conductor {{(pid=99294) start /opt/stack/nova/nova/service.py:199}} Jun 10 02:22:33.748409 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] notifications.notification_format = unversioned {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.748684 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] notifications.notify_on_state_change = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.749100 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.749464 n-d-779913-11 nova-conductor[99294]: DEBUG nova.servicegroup.drivers.db [None req-aae983c6-970b-47e9-a0b8-e02608bf96ff None None] DB_Driver: join new ServiceGroup member n-d-779913-11 to the conductor group, service = {{(pid=99294) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jun 10 02:22:33.749567 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] pci.alias = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.749901 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] pci.passthrough_whitelist = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.750336 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.auth_section = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.750757 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.auth_type = password {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.751730 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.auth_url = http://10.222.0.49/identity {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.752113 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.752493 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.752878 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.753277 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.connect_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.753658 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.connect_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.754058 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.default_domain_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.754444 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.default_domain_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.754816 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.domain_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.755248 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.domain_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.755628 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.endpoint_override = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.756013 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.756388 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.756766 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.max_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.757150 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.min_version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.757602 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.password = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.757983 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.project_domain_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.758371 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.project_domain_name = Default {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.758770 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.project_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.759192 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.project_name = service {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.759588 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.region_name = RegionOne {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.759963 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.service_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.760359 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.service_type = placement {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.760742 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.761116 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.status_code_retries = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.761517 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.status_code_retry_delay = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.761892 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.system_scope = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.762269 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.762645 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.trust_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.763059 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.user_domain_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.763453 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.user_domain_name = Default {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.763827 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.user_id = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.764233 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.username = placement {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.764647 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.765027 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] placement.version = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.765435 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] powervm.disk_driver = localdisk {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.765854 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] powervm.proc_units_factor = 0.1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.766533 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] powervm.volume_group_name = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.767892 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.cores = 20 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.768607 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.count_usage_from_placement = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.769012 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.769444 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.injected_file_content_bytes = 10240 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.769851 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.injected_file_path_length = 255 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.770247 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.injected_files = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.770740 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.instances = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.771221 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.key_pairs = 100 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.771873 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.metadata_items = 128 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.772288 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.ram = 51200 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.772685 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.recheck_quota = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.773091 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.server_group_members = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.773519 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] quota.server_groups = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.773898 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] rdp.enabled = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.774568 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.775255 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.776083 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.776787 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.image_metadata_prefilter = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.777346 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.777937 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.max_attempts = 3 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.778348 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.max_placement_results = 1000 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.778745 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.781852 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.query_placement_for_availability_zone = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.781852 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.query_placement_for_image_type_support = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.781852 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.781852 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] scheduler.workers = 2 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.781852 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.781852 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.782826 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.782826 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.782826 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.783264 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.783406 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789263 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789263 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.host_subset_size = 1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789263 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.image_properties_default_architecture = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789263 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789263 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.isolated_hosts = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789263 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.isolated_images = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789793 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.max_instances_per_host = 50 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789793 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789793 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789793 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789793 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.789793 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.790225 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.790225 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.790225 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.track_instance_changes = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.790225 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.790225 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] metrics.required = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.790587 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] metrics.weight_multiplier = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.790778 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] metrics.weight_of_unavailable = -10000.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.791386 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] metrics.weight_setting = [] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.792016 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.792407 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] serial_console.enabled = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.792834 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] serial_console.port_range = 10000:20000 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.793242 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.793642 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.794032 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] serial_console.serialproxy_port = 6083 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.794428 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_user.auth_section = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.794828 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_user.auth_type = password {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.795264 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_user.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.795646 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_user.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.796034 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_user.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.796422 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_user.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.796802 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_user.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.797200 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_user.send_service_user_token = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.797589 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_user.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.798002 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] service_user.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.798489 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] spice.agent_enabled = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.798889 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] spice.enabled = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.799561 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.800008 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] spice.html5proxy_host = 0.0.0.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.800399 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] spice.html5proxy_port = 6082 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.800967 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] spice.server_listen = 127.0.0.1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.801381 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.801780 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] upgrade_levels.baseapi = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.802262 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] upgrade_levels.cert = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.802557 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] upgrade_levels.compute = auto {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.802997 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] upgrade_levels.conductor = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.803382 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] upgrade_levels.scheduler = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.803795 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vendordata_dynamic_auth.auth_section = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.804183 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vendordata_dynamic_auth.auth_type = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.804562 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vendordata_dynamic_auth.cafile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.804941 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vendordata_dynamic_auth.certfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.805340 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vendordata_dynamic_auth.collect_timing = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.805724 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vendordata_dynamic_auth.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.806123 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vendordata_dynamic_auth.keyfile = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.806647 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vendordata_dynamic_auth.split_loggers = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.806853 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vendordata_dynamic_auth.timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.807332 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.api_retry_count = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.807711 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.ca_file = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.808088 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.cache_prefix = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.808466 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.cluster_name = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.808852 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.connection_pool_size = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.809227 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.console_delay_seconds = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.809601 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.datastore_regex = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.809986 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.host_ip = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.810360 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.host_password = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.810745 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.host_port = 443 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.811145 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.host_username = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.811538 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.insecure = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.811912 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.integration_bridge = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.812294 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.maximum_objects = 100 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.812688 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.pbm_default_policy = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.813067 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.pbm_enabled = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.813443 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.pbm_wsdl_location = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.814429 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.814813 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.serial_port_proxy_uri = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.815306 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.serial_port_service_uri = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.815713 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.task_poll_interval = 0.5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.816254 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.use_linked_clone = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.816492 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.vnc_keymap = en-us {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.816868 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.vnc_port = 5900 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.817265 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vmware.vnc_port_total = 10000 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.817739 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vnc.auth_schemes = ['none'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.818129 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vnc.enabled = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.818754 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.819195 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.819616 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vnc.novncproxy_port = 6080 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.820042 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vnc.server_listen = 127.0.0.1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.820477 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.820875 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vnc.vencrypt_ca_certs = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.821253 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vnc.vencrypt_client_cert = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.821647 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] vnc.vencrypt_client_key = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.822040 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.disable_fallback_pcpu_query = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.822424 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.disable_group_policy_check_upcall = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.822806 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.823239 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.disable_native_luksv1 = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.823647 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.disable_rootwrap = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.824028 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.enable_numa_live_migration = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.824412 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.824794 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.handle_virt_lifecycle_events = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.825199 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.never_download_image_if_on_rbd = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.825587 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.rbd_volume_local_attach = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.825968 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.826644 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.826907 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.client_socket_timeout = 900 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.827238 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.default_pool_size = 1000 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.827693 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.keep_alive = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.828033 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.max_header_line = 16384 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.828415 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.secure_proxy_ssl_header = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.828797 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.ssl_ca_file = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.829787 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.ssl_cert_file = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.830335 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.ssl_key_file = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.830756 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.tcp_keepidle = 600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.831198 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.831751 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] zvm.ca_file = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.831979 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] zvm.cloud_connector_url = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.832484 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.832874 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] zvm.reachable_timeout = 300 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.833330 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_policy.enforce_new_defaults = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.833723 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_policy.enforce_scope = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.834130 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_policy.policy_default_rule = default {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.834571 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.834998 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_policy.policy_file = policy.yaml {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.835443 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.835836 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.836217 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.836613 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.836997 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.837415 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.837862 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] profiler.connection_string = messaging:// {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.838258 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] profiler.enabled = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.838741 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] profiler.es_doc_type = notification {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.839176 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] profiler.es_scroll_size = 10000 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.839570 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] profiler.es_scroll_time = 2m {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.839953 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] profiler.filter_error_trace = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.840349 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] profiler.hmac_keys = SECRET_KEY {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.840748 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] profiler.sentinel_service_name = mymaster {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.841147 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] profiler.socket_timeout = 0.1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.841526 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] profiler.trace_sqlalchemy = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.841963 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.backend = sqlalchemy {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.842373 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.connection = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.842761 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.connection_debug = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.843464 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.connection_parameters = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.843640 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.connection_recycle_time = 3600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.844237 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.connection_trace = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.844619 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.db_inc_retry_interval = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.845072 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.db_max_retries = 20 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.845468 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.db_max_retry_interval = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.846037 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.db_retry_interval = 1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.846434 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.max_overflow = 50 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.846877 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.max_pool_size = 5 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.847257 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.max_retries = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.847625 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.mysql_enable_ndb = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.848025 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.848406 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.pool_timeout = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.848798 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.retry_interval = 10 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.849177 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.slave_connection = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.849572 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.sqlite_synchronous = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.849959 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.use_db_reconnect = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.850351 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] database.use_tpool = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.850786 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] remote_debug.host = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.851212 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] remote_debug.port = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.851640 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.852045 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.852432 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.852826 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.853221 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.853617 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.854023 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.854424 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.854823 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.855237 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.855657 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.856050 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.856459 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.856859 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.857315 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.857664 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.858150 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.858436 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.858821 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.859252 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.859647 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.860053 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.ssl = False {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.860722 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.860964 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.861371 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.861786 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_rabbit.ssl_version = {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.862242 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.862635 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_notifications.retry = -1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.863102 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.863509 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_messaging_notifications.transport_url = **** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.863940 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_reports.file_event_handler = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.864346 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.864789 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] oslo_reports.log_dir = None {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 02:22:33.865037 n-d-779913-11 nova-conductor[98426]: DEBUG oslo_service.service [None req-afd36a7e-b0e6-454f-8e8b-76d3d54fb0fc None None] ******************************************************************************** {{(pid=98426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 10 02:25:33.683992 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:25:33.735048 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:25:34.705418 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 57544. Jun 10 02:25:34.757442 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 57546. Jun 10 02:28:34.701649 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:28:34.752597 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:28:35.724581 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 57614. Jun 10 02:28:35.773952 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 57616. Jun 10 02:31:35.722114 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:31:35.770156 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:31:36.744868 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 57734. Jun 10 02:31:36.793529 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 57736. Jun 10 02:32:14.802114 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_db.sqlalchemy.engines [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Parent process 98426 forked (99293) with an open database connection, which is being discarded and recreated. {{(pid=99293) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Jun 10 02:32:17.112362 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Took 2.28 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:32:17.164485 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:17.168699 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:17.231050 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_db.sqlalchemy.engines [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 02:32:17.899297 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:17.903410 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:17.916239 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:17.919243 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:17.991253 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_db.sqlalchemy.engines [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 02:32:18.078817 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Getting quotas for project 783ee92f1ead4fef98cbd0b0cef18f10. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:32:18.090346 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Getting quotas for user d73715943bf6437cbae1b66b4d63dd52 and project 783ee92f1ead4fef98cbd0b0cef18f10. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:32:18.129723 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] [instance: ec7d9901-8d58-4509-9827-77507647b179] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:32:18.131524 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:18.132456 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:18.237162 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] [instance: ec7d9901-8d58-4509-9827-77507647b179] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:32:18.240619 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:18.241353 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:18.641791 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:18.642622 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:18.643641 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-107db6ea-1979-438d-b7fb-488e1c94e546 tempest-AggregatesAdminTestJSON-697178989 tempest-AggregatesAdminTestJSON-697178989-project] Acquired lock "compute-rpcapi-router" {{(pid=99293) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jun 10 02:32:18.651110 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c7ca600f-63f8-4d8e-9493-89c83406672a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:18.651110 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c7ca600f-63f8-4d8e-9493-89c83406672a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:18.651110 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c7ca600f-63f8-4d8e-9493-89c83406672a None None] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:18.651110 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c7ca600f-63f8-4d8e-9493-89c83406672a None None] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:18.725899 n-d-779913-11 nova-conductor[99293]: INFO nova.compute.rpcapi [None req-c7ca600f-63f8-4d8e-9493-89c83406672a None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jun 10 02:32:18.727327 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c7ca600f-63f8-4d8e-9493-89c83406672a None None] Releasing lock "compute-rpcapi-router" {{(pid=99293) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jun 10 02:32:20.964765 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_db.sqlalchemy.engines [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Parent process 98426 forked (99294) with an open database connection, which is being discarded and recreated. {{(pid=99294) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Jun 10 02:32:22.070578 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Took 1.08 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:32:22.155301 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:22.172071 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:22.218363 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_db.sqlalchemy.engines [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 02:32:22.590321 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:22.595510 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:22.596640 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:22.606576 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:22.699607 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_db.sqlalchemy.engines [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 02:32:22.761502 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Getting quotas for project cd12ea93ec684d47b25376b06a93c1eb. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:32:22.782564 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Getting quotas for user b26678f09a0543a7aa88798cf042814c and project cd12ea93ec684d47b25376b06a93c1eb. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:32:22.826967 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] [instance: 5d8b7df2-052e-4107-b305-e85e7d50ccd8] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:32:22.833093 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:22.834218 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:22.931473 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] [instance: 5d8b7df2-052e-4107-b305-e85e7d50ccd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:32:22.937228 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:22.938368 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:23.486160 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:23.487160 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:23.487160 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-aa6dfc70-821c-4210-b0ba-96b5bd6c19ae tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Acquired lock "compute-rpcapi-router" {{(pid=99294) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jun 10 02:32:23.497417 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1dc596f2-c9af-4271-a4a0-4c11ba2a4a49 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:23.500605 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1dc596f2-c9af-4271-a4a0-4c11ba2a4a49 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:23.505193 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1dc596f2-c9af-4271-a4a0-4c11ba2a4a49 None None] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:23.505634 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1dc596f2-c9af-4271-a4a0-4c11ba2a4a49 None None] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:23.564592 n-d-779913-11 nova-conductor[99294]: INFO nova.compute.rpcapi [None req-1dc596f2-c9af-4271-a4a0-4c11ba2a4a49 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jun 10 02:32:23.569335 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1dc596f2-c9af-4271-a4a0-4c11ba2a4a49 None None] Releasing lock "compute-rpcapi-router" {{(pid=99294) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jun 10 02:32:45.783655 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:32:45.854139 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:45.855741 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:46.122843 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:46.123563 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:46.125056 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:46.125743 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:46.205991 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Getting quotas for project 10c58b5ce41a40dca90f902197e8d648. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:32:46.213532 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Getting quotas for user c7c14dd0498e4930ba7300ed631329ed and project 10c58b5ce41a40dca90f902197e8d648. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:32:46.262841 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] [instance: eaebdf8d-e146-4003-941d-54fc7470bf33] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:32:46.264587 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:46.265251 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:46.337601 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] [instance: eaebdf8d-e146-4003-941d-54fc7470bf33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:32:46.337601 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:46.338003 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:32:46.613462 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:32:46.613875 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bdf00cb6-7d42-4ff4-9a19-16bee5b3ca2e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:04.821884 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Took 0.92 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:33:04.866920 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:04.867770 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:05.217799 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:05.218339 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:05.219186 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:05.219809 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:05.237449 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Getting quotas for project dd456ab92e34402b9a837f6fd153e4a3. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:33:05.242856 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Getting quotas for user aa448d7558ed439da1f9a21d16f128ff and project dd456ab92e34402b9a837f6fd153e4a3. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:33:05.256026 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] [instance: 08ad6222-9bc6-4d74-893b-41a2b7170a99] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:33:05.257124 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:05.259176 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:05.368645 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] [instance: 08ad6222-9bc6-4d74-893b-41a2b7170a99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:33:05.372536 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:05.373449 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:05.688467 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:05.689956 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7c006289-138b-4649-b289-967dc70d0277 tempest-ServerDiagnosticsNegativeTest-749185650 tempest-ServerDiagnosticsNegativeTest-749185650-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:11.434485 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:33:11.514859 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:11.518169 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:11.743565 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:11.747363 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:11.748602 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:11.749906 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:11.826158 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Getting quotas for project cd12ea93ec684d47b25376b06a93c1eb. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:33:11.851037 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Getting quotas for user b26678f09a0543a7aa88798cf042814c and project cd12ea93ec684d47b25376b06a93c1eb. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:33:11.879161 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] [instance: 41c13485-fe4f-4256-a9e5-3684f26df626] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:33:11.881276 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:11.882188 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:11.969149 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] [instance: 41c13485-fe4f-4256-a9e5-3684f26df626] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:33:11.978081 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:11.982779 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:12.349495 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:12.352129 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-eaf8119c-2298-4d45-ab34-5423df4371b5 tempest-DeleteServersAdminTestJSON-1921104487 tempest-DeleteServersAdminTestJSON-1921104487-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:51.375937 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:33:51.434519 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:51.435701 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:51.776164 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:51.786091 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:51.792456 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:51.797177 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:51.902405 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Getting quotas for project 00505fdceb95466dbbf227de4289b0e2. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:33:51.936423 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Getting quotas for user f0fb623674fa4a71acc0a50f25328ae4 and project 00505fdceb95466dbbf227de4289b0e2. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:33:51.979066 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] [instance: e77bb3be-1308-4a5e-a81b-8fafef890d1a] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:33:51.981337 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:51.987912 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:52.088348 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] [instance: e77bb3be-1308-4a5e-a81b-8fafef890d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:33:52.090916 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:52.091791 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:52.392096 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:52.392811 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6f8d8563-4d32-4a26-b5c7-99bf2ab79821 tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:53.580665 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:33:53.611872 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:53.612279 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:53.864178 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:53.865212 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:53.866413 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:53.867392 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:53.907587 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Getting quotas for project 86105f817cdb4e57a60bcb83f8cfe318. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:33:53.918294 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Getting quotas for user ea843d7a9f834b72a2dc07797323a167 and project 86105f817cdb4e57a60bcb83f8cfe318. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:33:53.942632 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] [instance: db7b2812-fc6a-4e68-a751-10ada8016360] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:33:53.944730 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:53.945415 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:54.051729 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] [instance: db7b2812-fc6a-4e68-a751-10ada8016360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:33:54.053927 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:54.054854 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:54.359706 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:54.360268 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-14fca7c5-9b17-4ca7-ab23-147c226321c1 tempest-TenantUsagesTestJSON-1364487495 tempest-TenantUsagesTestJSON-1364487495-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:56.638336 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:33:56.668869 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:56.670673 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:56.941947 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:56.942408 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:56.943171 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:56.943618 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:56.967674 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Getting quotas for project b38319811afb430e8de0c4249f1a1aa1. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:33:56.988378 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Getting quotas for user de91badf8c9b4abeb8a3368631e71133 and project b38319811afb430e8de0c4249f1a1aa1. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:33:57.024567 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: b9375a6c-00ab-4fb7-8336-86b34d8d9021] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:33:57.026871 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:57.027927 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:57.184128 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: b9375a6c-00ab-4fb7-8336-86b34d8d9021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:33:57.185732 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:57.186193 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:33:58.034420 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:33:58.034420 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-b0626348-6d8c-40d0-943e-de16ae7cd9f8 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:04.978225 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:34:05.031585 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:05.032228 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:05.471928 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:05.473151 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:05.475760 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:05.478467 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:05.534451 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Getting quotas for project b95a4e41a0e24a96acf9488e20b25566. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:34:05.545109 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Getting quotas for user 66c535d115d04bfbbc33ea3f15d2910a and project b95a4e41a0e24a96acf9488e20b25566. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:34:05.571380 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] [instance: 03621ea2-53d8-43a6-ad2b-e85dda6e204a] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:34:05.573154 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:05.573908 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:05.706530 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] [instance: 03621ea2-53d8-43a6-ad2b-e85dda6e204a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:34:05.711229 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:05.712179 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:06.156104 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:06.156767 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9e9384ac-0de9-43fc-85b6-13f98ac1b921 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:09.551163 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Took 1.09 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:34:09.607893 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:09.608822 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:09.926520 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:09.926932 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:09.927824 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:09.930228 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:09.968546 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Getting quotas for project 3e0de7e8246b4cb58c214eaf69fb0a95. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:34:09.974619 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Getting quotas for user 93ef6b1e04a142db8adb2630c40a60bf and project 3e0de7e8246b4cb58c214eaf69fb0a95. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:34:09.996378 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] [instance: 2c8d6557-087d-43a6-86c0-e5908a492b48] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:34:09.998627 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:10.000112 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:10.110225 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] [instance: 2c8d6557-087d-43a6-86c0-e5908a492b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:34:10.111995 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:10.112562 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:10.542201 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:10.543466 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-db5eccd6-2b76-4b02-be4b-8ecba10ce660 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:16.911249 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:34:16.956321 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:16.957340 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:17.207811 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:17.208120 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:17.209046 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:17.209433 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:17.227699 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Getting quotas for project 41bd650913a641e4ba10c65c8394a710. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:34:17.233048 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Getting quotas for user 8a884ed3accf4eb495ac5aa643e66e5d and project 41bd650913a641e4ba10c65c8394a710. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:34:17.245421 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] [instance: b36c591d-0e2b-44fa-a2ff-320e4bcf8149] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:34:17.246370 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:17.246772 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:17.326769 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] [instance: b36c591d-0e2b-44fa-a2ff-320e4bcf8149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:34:17.328957 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:17.329395 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:17.716247 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:17.717501 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8fddf308-4b44-4d96-9c7f-1f8239d69498 tempest-VolumesAdminNegativeTest-2016028830 tempest-VolumesAdminNegativeTest-2016028830-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:23.681807 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-855ca23c-1c2e-4a02-8989-381200daebb4 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:34:23.688014 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-855ca23c-1c2e-4a02-8989-381200daebb4 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:23.693045 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-855ca23c-1c2e-4a02-8989-381200daebb4 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:24.642717 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:34:24.705799 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:24.706463 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:24.853421 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-855ca23c-1c2e-4a02-8989-381200daebb4 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] [instance: b9375a6c-00ab-4fb7-8336-86b34d8d9021] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99294) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 02:34:24.905505 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:24.906431 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:24.907675 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:24.908276 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:24.934785 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Getting quotas for project 00505fdceb95466dbbf227de4289b0e2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:34:24.945989 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Getting quotas for user f0fb623674fa4a71acc0a50f25328ae4 and project 00505fdceb95466dbbf227de4289b0e2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:34:24.971219 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] [instance: e7efb449-696a-4bce-a0ec-0887b3252489] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:34:24.990596 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:24.992035 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:25.087664 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] [instance: e7efb449-696a-4bce-a0ec-0887b3252489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:34:25.090644 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:25.091824 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:25.486044 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:25.487647 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-68d24f4a-dfa3-4137-b18a-94c3f3ecc3df tempest-ServersAdminNegativeTestJSON-240674942 tempest-ServersAdminNegativeTestJSON-240674942-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:25.965059 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-855ca23c-1c2e-4a02-8989-381200daebb4 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] Created allocations for migration 80956b01-13fc-4008-ba14-00ad9da06622 on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:34:26.812783 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-855ca23c-1c2e-4a02-8989-381200daebb4 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] [instance: b9375a6c-00ab-4fb7-8336-86b34d8d9021] Calling prep_resize with selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99294) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 02:34:36.095923 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-85612261-9534-466b-9059-e3363c44b610 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:34:36.096982 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-85612261-9534-466b-9059-e3363c44b610 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:36.097931 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-85612261-9534-466b-9059-e3363c44b610 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:37.063064 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-85612261-9534-466b-9059-e3363c44b610 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Created allocations for migration 369fa63c-183c-44d3-b21b-2ba3f3af1896 on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:34:37.153124 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:34:37.195913 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:37.197374 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:37.463081 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:37.463671 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:37.464532 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:37.465030 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:37.483207 n-d-779913-11 nova-conductor[99294]: DEBUG nova.scheduler.utils [None req-85612261-9534-466b-9059-e3363c44b610 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] [instance: 03621ea2-53d8-43a6-ad2b-e85dda6e204a] Instance allocations successfully created on destination node a6476fd0-f26b-421b-aa0f-9bdb0ef7b967: {'allocations': {'a6476fd0-f26b-421b-aa0f-9bdb0ef7b967': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99294) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Jun 10 02:34:37.484045 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-85612261-9534-466b-9059-e3363c44b610 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lazy-loading 'resources' on Instance uuid 03621ea2-53d8-43a6-ad2b-e85dda6e204a {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:34:37.490286 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Getting quotas for project cddc729c61334cfd8ce41b8d709a5a5c. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:34:37.495636 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-85612261-9534-466b-9059-e3363c44b610 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lazy-loading 'pci_requests' on Instance uuid 03621ea2-53d8-43a6-ad2b-e85dda6e204a {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:34:37.498342 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Getting quotas for user b17e5766981445ff914601fa25380ca7 and project cddc729c61334cfd8ce41b8d709a5a5c. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:34:37.515986 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] [instance: 29f9f517-3404-4ec4-ba31-75ea4e3be1d6] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:34:37.517624 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:37.518218 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:37.598752 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] [instance: 29f9f517-3404-4ec4-ba31-75ea4e3be1d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:34:37.600335 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:37.600827 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:37.983610 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:37.984182 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f4231a1e-9f14-48f9-9e99-6989b3f755b1 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:38.682898 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.live_migrate [None req-85612261-9534-466b-9059-e3363c44b610 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] [instance: 03621ea2-53d8-43a6-ad2b-e85dda6e204a] Start binding ports on destination host: n-h2-779913-11 {{(pid=99294) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jun 10 02:34:45.535482 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:34:45.562534 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:45.563089 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:45.770251 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:45.770581 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:45.771370 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:45.771778 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:45.809292 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Getting quotas for project 3e0de7e8246b4cb58c214eaf69fb0a95. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:34:45.817963 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Getting quotas for user 93ef6b1e04a142db8adb2630c40a60bf and project 3e0de7e8246b4cb58c214eaf69fb0a95. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:34:45.833138 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] [instance: f3f4a535-4177-424d-a1b3-e22e1ffb00f9] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:34:45.834564 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:45.837491 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:45.949975 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] [instance: f3f4a535-4177-424d-a1b3-e22e1ffb00f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:34:45.952034 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:45.952034 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:46.358794 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:46.359357 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf1a021b-01c9-42a5-908c-50be14ec0502 tempest-LiveMigrationNegativeTest-1114826843 tempest-LiveMigrationNegativeTest-1114826843-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:50.581326 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:34:50.632827 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:50.634403 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:50.846695 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:50.847414 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:50.853885 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:50.860523 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:50.928653 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Getting quotas for project 10c58b5ce41a40dca90f902197e8d648. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:34:50.949548 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Getting quotas for user c7c14dd0498e4930ba7300ed631329ed and project 10c58b5ce41a40dca90f902197e8d648. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:34:50.988251 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] [instance: f021664a-8752-461d-9ee6-d186395d95f0] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:34:50.989834 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:50.990509 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:51.205612 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] [instance: f021664a-8752-461d-9ee6-d186395d95f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:34:51.208282 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:51.209277 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:51.322845 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:51.324146 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:34:51.708699 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:34:51.709817 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3fc00c4-1cd1-4c37-af96-763a2ce5474e tempest-ServersWithSpecificFlavorTestJSON-1570266947 tempest-ServersWithSpecificFlavorTestJSON-1570266947-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:10.125353 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:35:10.153498 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:10.153914 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:10.335262 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:10.335973 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:10.337663 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:10.338586 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:10.371591 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Getting quotas for project b95a4e41a0e24a96acf9488e20b25566. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:35:10.380011 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Getting quotas for user 66c535d115d04bfbbc33ea3f15d2910a and project b95a4e41a0e24a96acf9488e20b25566. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:35:10.404294 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] [instance: dceec400-738b-403a-9a1c-d3f08a4a0fd9] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:35:10.416705 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:10.421385 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:10.535464 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] [instance: dceec400-738b-403a-9a1c-d3f08a4a0fd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:35:10.537897 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:10.538773 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:10.875047 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:10.875047 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c9e0c683-e176-4742-9029-fd672e2f61ad tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:13.672109 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:35:13.724335 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:13.725019 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:14.092333 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:14.093040 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:14.094066 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:14.094543 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:14.122435 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Getting quotas for project 04d0e69b521847bfafb3208ed5bb9c4f. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:35:14.130724 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Getting quotas for user dce3ac4307e448d3828347931812df5c and project 04d0e69b521847bfafb3208ed5bb9c4f. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:35:14.225806 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] [instance: ed577f4c-882c-4dc0-8010-de582075ba0d] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:35:14.225806 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:14.225806 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:14.370206 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] [instance: ed577f4c-882c-4dc0-8010-de582075ba0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:35:14.371671 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:14.372252 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:14.542116 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-218ea148-eb5f-44fd-8cfb-831e38f064b4 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:35:14.543928 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-218ea148-eb5f-44fd-8cfb-831e38f064b4 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:14.544646 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-218ea148-eb5f-44fd-8cfb-831e38f064b4 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:14.746340 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:14.748743 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6d121c07-5282-4ea5-baa4-9ad9d15863f6 tempest-ImagesNegativeTestJSON-107540167 tempest-ImagesNegativeTestJSON-107540167-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:15.674916 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-218ea148-eb5f-44fd-8cfb-831e38f064b4 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Created allocations for migration a4c5ea72-294e-4d49-a3c7-6f1fbd788f0c on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:35:16.078273 n-d-779913-11 nova-conductor[99294]: DEBUG nova.scheduler.utils [None req-218ea148-eb5f-44fd-8cfb-831e38f064b4 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] [instance: 29f9f517-3404-4ec4-ba31-75ea4e3be1d6] Instance allocations successfully created on destination node 31af5d91-4a28-44aa-87b2-ca38c3499d20: {'allocations': {'31af5d91-4a28-44aa-87b2-ca38c3499d20': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99294) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Jun 10 02:35:16.079036 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-218ea148-eb5f-44fd-8cfb-831e38f064b4 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lazy-loading 'resources' on Instance uuid 29f9f517-3404-4ec4-ba31-75ea4e3be1d6 {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:35:16.088343 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-218ea148-eb5f-44fd-8cfb-831e38f064b4 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lazy-loading 'pci_requests' on Instance uuid 29f9f517-3404-4ec4-ba31-75ea4e3be1d6 {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:35:17.276794 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.live_migrate [None req-218ea148-eb5f-44fd-8cfb-831e38f064b4 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] [instance: 29f9f517-3404-4ec4-ba31-75ea4e3be1d6] Start binding ports on destination host: n-h1-779913-11 {{(pid=99294) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jun 10 02:35:25.514260 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:35:25.602417 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:25.603625 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:25.887380 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:25.904061 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:25.904061 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:25.904061 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:25.931335 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Getting quotas for project b38319811afb430e8de0c4249f1a1aa1. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:35:25.940435 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Getting quotas for user de91badf8c9b4abeb8a3368631e71133 and project b38319811afb430e8de0c4249f1a1aa1. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:35:25.970654 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: 0a3a743e-3c9c-464a-b729-e040e4b0a873] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:35:25.972677 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:25.973796 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:26.098694 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: 0a3a743e-3c9c-464a-b729-e040e4b0a873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:35:26.100058 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:26.101100 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:26.555214 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:26.557885 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-108b0e2e-cfa6-494c-9724-027060ff1770 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:37.236697 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:35:37.278425 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:37.279119 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:37.541839 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:37.542517 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:37.543833 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:37.544514 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:37.603832 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:35:37.611957 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for user af250ecb6a7643cd92b243905597400f and project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:35:37.633320 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 9e794e56-4ee0-40f9-887e-bc6be6636434] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:35:37.635579 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:37.636529 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:37.702699 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 9e794e56-4ee0-40f9-887e-bc6be6636434] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:35:37.704637 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:37.705034 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:37.983465 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:37.984932 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e2943d48-b60c-4591-bf42-3585c7059215 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:42.595685 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:35:42.706041 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:42.706762 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:42.922226 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:42.923437 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:42.928009 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:42.928973 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:42.973500 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Getting quotas for project cddc729c61334cfd8ce41b8d709a5a5c. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:35:42.988241 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Getting quotas for user b17e5766981445ff914601fa25380ca7 and project cddc729c61334cfd8ce41b8d709a5a5c. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:35:43.030450 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] [instance: 681046cc-8598-427e-a6e9-90f9af307667] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:35:43.032468 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:43.033489 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:43.154039 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] [instance: 681046cc-8598-427e-a6e9-90f9af307667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:35:43.156017 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:43.156977 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:43.522541 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:43.523200 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3a731f4-2345-420a-9c19-bea037edaa0e tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:47.562203 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-19bab508-4720-4e6b-ade2-4d8550121eb1 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:35:47.564220 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-19bab508-4720-4e6b-ade2-4d8550121eb1 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:47.565144 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-19bab508-4720-4e6b-ade2-4d8550121eb1 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:48.958544 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-19bab508-4720-4e6b-ade2-4d8550121eb1 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Created allocations for migration 0fc3e250-24ff-473a-96ae-8ef850c2c238 on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:35:49.437985 n-d-779913-11 nova-conductor[99294]: DEBUG nova.scheduler.utils [None req-19bab508-4720-4e6b-ade2-4d8550121eb1 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] [instance: dceec400-738b-403a-9a1c-d3f08a4a0fd9] Instance allocations successfully created on destination node 31af5d91-4a28-44aa-87b2-ca38c3499d20: {'allocations': {'31af5d91-4a28-44aa-87b2-ca38c3499d20': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99294) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Jun 10 02:35:49.438411 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-19bab508-4720-4e6b-ade2-4d8550121eb1 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lazy-loading 'resources' on Instance uuid dceec400-738b-403a-9a1c-d3f08a4a0fd9 {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:35:49.444166 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-19bab508-4720-4e6b-ade2-4d8550121eb1 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lazy-loading 'pci_requests' on Instance uuid dceec400-738b-403a-9a1c-d3f08a4a0fd9 {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:35:50.197271 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.live_migrate [None req-19bab508-4720-4e6b-ade2-4d8550121eb1 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] [instance: dceec400-738b-403a-9a1c-d3f08a4a0fd9] Start binding ports on destination host: n-h1-779913-11 {{(pid=99294) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jun 10 02:35:50.565232 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b13bfa04-1917-4ed2-bd1c-e60f75ddd971 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:35:50.565770 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b13bfa04-1917-4ed2-bd1c-e60f75ddd971 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:35:50.567660 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b13bfa04-1917-4ed2-bd1c-e60f75ddd971 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:35:51.607242 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-b13bfa04-1917-4ed2-bd1c-e60f75ddd971 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: 0a3a743e-3c9c-464a-b729-e040e4b0a873] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99293) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 02:35:52.697728 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-b13bfa04-1917-4ed2-bd1c-e60f75ddd971 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Created allocations for migration d089fa95-bdb6-4492-abf0-9eb4da28c3bb on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99293) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:35:53.283219 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-b13bfa04-1917-4ed2-bd1c-e60f75ddd971 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: 0a3a743e-3c9c-464a-b729-e040e4b0a873] Calling prep_resize with selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [Selection(allocation_request='{"allocations": {"31af5d91-4a28-44aa-87b2-ca38c3499d20": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["31af5d91-4a28-44aa-87b2-ca38c3499d20"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=3a558ffc-c5f1-432a-9dcf-9c326fcb959c,compute_node_uuid=31af5d91-4a28-44aa-87b2-ca38c3499d20,limits=SchedulerLimits,nodename='n-h1-779913-11',service_host='n-h1-779913-11')] {{(pid=99293) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 02:36:09.484012 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:09.484627 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:11.048976 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Took 1.38 seconds to select destinations for 2 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:36:11.073025 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:11.073438 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:11.275247 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:11.275507 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:11.454355 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:11.455118 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:11.456196 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:11.456756 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:11.490542 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:36:11.505592 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for user af250ecb6a7643cd92b243905597400f and project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:36:11.529031 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 6ac929c8-2c31-4b48-a83b-21104b12185e] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:36:11.530255 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:11.530826 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:11.645181 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 6ac929c8-2c31-4b48-a83b-21104b12185e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:36:11.647620 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:11.648553 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:11.937820 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:11.938720 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:11.980825 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 23b236b8-e48a-49a6-b77a-dee2fa623fff] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:36:11.981279 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance_group [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lazy-loading 'hosts' on InstanceGroup uuid 307582b9-1f2d-4dc1-a466-62c42d7dc7da {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Jun 10 02:36:12.036693 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:12.037987 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:12.163571 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 23b236b8-e48a-49a6-b77a-dee2fa623fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:36:12.165678 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:12.166369 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:12.577130 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:12.578246 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3ce851ae-c229-4dfe-ab45-0e457199b7a1 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:15.505756 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-e1644450-19eb-4d2c-9ee6-327da758dd01 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:36:15.508668 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e1644450-19eb-4d2c-9ee6-327da758dd01 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:15.509661 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e1644450-19eb-4d2c-9ee6-327da758dd01 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:16.773017 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-e1644450-19eb-4d2c-9ee6-327da758dd01 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Created allocations for migration 8bc1418b-0e7b-4075-b25d-c01cfe24c7d3 on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99293) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:36:17.227240 n-d-779913-11 nova-conductor[99293]: DEBUG nova.scheduler.utils [None req-e1644450-19eb-4d2c-9ee6-327da758dd01 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] [instance: 681046cc-8598-427e-a6e9-90f9af307667] Instance allocations successfully created on destination node a6476fd0-f26b-421b-aa0f-9bdb0ef7b967: {'allocations': {'a6476fd0-f26b-421b-aa0f-9bdb0ef7b967': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99293) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Jun 10 02:36:17.227701 n-d-779913-11 nova-conductor[99293]: DEBUG nova.objects.instance [None req-e1644450-19eb-4d2c-9ee6-327da758dd01 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lazy-loading 'resources' on Instance uuid 681046cc-8598-427e-a6e9-90f9af307667 {{(pid=99293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:36:17.242154 n-d-779913-11 nova-conductor[99293]: DEBUG nova.objects.instance [None req-e1644450-19eb-4d2c-9ee6-327da758dd01 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lazy-loading 'pci_requests' on Instance uuid 681046cc-8598-427e-a6e9-90f9af307667 {{(pid=99293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:36:18.969120 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.live_migrate [None req-e1644450-19eb-4d2c-9ee6-327da758dd01 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] [instance: 681046cc-8598-427e-a6e9-90f9af307667] Start binding ports on destination host: n-h2-779913-11 {{(pid=99293) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jun 10 02:36:19.995235 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:36:20.084115 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:20.090437 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:20.522503 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:20.524134 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:20.525242 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:20.525817 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:20.581152 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Getting quotas for project 3c6d911ce06d43e49e442816c8c23bfd. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:36:20.598374 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Getting quotas for user b5fa487012784860937d6aed10d7edfd and project 3c6d911ce06d43e49e442816c8c23bfd. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:36:20.643393 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] [instance: 4e8999dc-a9ef-4639-82f9-43e7f7a29979] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:36:20.648595 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:20.648595 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:20.793124 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] [instance: 4e8999dc-a9ef-4639-82f9-43e7f7a29979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:36:20.795052 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:20.795642 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:21.229425 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:21.230753 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0d897a11-35af-40ea-8618-8721745edcd2 tempest-InstanceActionsTestJSON-496860699 tempest-InstanceActionsTestJSON-496860699-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:28.058155 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:36:28.109417 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:28.110202 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:28.312548 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:28.313011 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:28.314237 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:28.320245 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:28.371239 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Getting quotas for project b95a4e41a0e24a96acf9488e20b25566. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:36:28.380073 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Getting quotas for user 66c535d115d04bfbbc33ea3f15d2910a and project b95a4e41a0e24a96acf9488e20b25566. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:36:28.404844 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] [instance: 4dbb7a7e-2366-4a9e-bd20-f9bf73dff05a] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:36:28.410215 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:28.412348 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:28.478343 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] [instance: 4dbb7a7e-2366-4a9e-bd20-f9bf73dff05a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:36:28.480119 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:28.481118 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:28.734062 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:28.735214 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-582bd712-e3fa-4a93-8712-2a3fea000a54 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:54.937456 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Took 1.21 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:36:55.120600 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:55.126646 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:55.256875 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Took 1.24 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:36:55.379300 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:55.379713 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:55.381005 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:55.381407 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:55.409004 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Getting quotas for project b38319811afb430e8de0c4249f1a1aa1. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:36:55.421515 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Getting quotas for user de91badf8c9b4abeb8a3368631e71133 and project b38319811afb430e8de0c4249f1a1aa1. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:36:55.431817 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:55.433358 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:55.456945 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: 56343a33-9323-4628-9347-50c9d74acf3c] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:36:55.457935 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:55.469936 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:55.580934 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: 56343a33-9323-4628-9347-50c9d74acf3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:36:55.582827 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:55.584378 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:55.688234 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:55.692931 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:55.694294 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:55.694845 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:55.767495 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Getting quotas for project cddc729c61334cfd8ce41b8d709a5a5c. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:36:55.784055 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Getting quotas for user b17e5766981445ff914601fa25380ca7 and project cddc729c61334cfd8ce41b8d709a5a5c. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:36:55.805164 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] [instance: 5983949d-e81a-49fb-8fd1-cdcfc602fec0] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:36:55.806416 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:55.807066 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:55.991349 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] [instance: 5983949d-e81a-49fb-8fd1-cdcfc602fec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:36:55.995601 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:55.996396 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:56.482865 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:56.487039 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-74596fa2-d0fe-45cf-8c39-101af720ad5b tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:36:56.968476 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:36:56.969189 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-142d395a-ce3e-4651-9deb-25eb2d25436f tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:12.735701 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:12.736485 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:14.654283 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Took 1.86 seconds to select destinations for 2 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:37:14.731354 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:14.731726 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:14.941065 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:14.941759 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:15.290377 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:15.291631 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:15.292691 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:15.307766 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:15.376081 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:37:15.393950 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for user af250ecb6a7643cd92b243905597400f and project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:37:15.431410 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 1d9144e2-e45c-4587-b527-1508112a9a4d] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:37:15.435043 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:15.435872 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:15.648973 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 1d9144e2-e45c-4587-b527-1508112a9a4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:37:15.653628 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:15.653628 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:16.071103 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:16.071764 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:16.096502 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 4b172f1e-3dff-4895-89d2-d975a95abdaf] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:37:16.098842 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance_group [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lazy-loading 'hosts' on InstanceGroup uuid 11535c0d-3485-49fc-ab04-36189bc34d03 {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Jun 10 02:37:16.155340 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:16.155903 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:16.351012 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 4b172f1e-3dff-4895-89d2-d975a95abdaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:37:16.352524 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:16.356722 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:16.811501 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:16.812859 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c147031c-ac44-434d-a00b-d37a9fe89963 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:36.758483 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Took 1.21 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:37:36.829916 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:36.829916 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:37.361041 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:37.364273 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:37.368222 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:37.368222 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:37.465903 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Getting quotas for project 8314ef6b49ca480e891bd66ca2c81cd5. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:37:37.491237 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Getting quotas for user bc00110dc6c24472b9bc17944938e58e and project 8314ef6b49ca480e891bd66ca2c81cd5. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:37:37.568228 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] [instance: 411f6fc7-2b9e-4d70-a0e8-42ad7a692463] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:37:37.570324 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:37.578066 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:37.671751 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] [instance: 411f6fc7-2b9e-4d70-a0e8-42ad7a692463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:37:37.674584 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:37.675588 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:38.128450 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-20654fb3-02fb-4f21-beab-c75a1b324cf2 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:37:38.129740 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-20654fb3-02fb-4f21-beab-c75a1b324cf2 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:38.130310 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-20654fb3-02fb-4f21-beab-c75a1b324cf2 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:38.217538 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:38.218189 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2200e19-ebfa-4913-9362-ad94729a91b8 tempest-ServerAddressesTestJSON-1714806139 tempest-ServerAddressesTestJSON-1714806139-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:38.949377 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:37:38.996005 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:38.996769 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:39.587192 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-20654fb3-02fb-4f21-beab-c75a1b324cf2 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Created allocations for migration 5739d4fd-06aa-436d-93f6-8783b2ba277c on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99293) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:37:39.597203 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:39.599371 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:39.600993 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:39.601893 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:39.643324 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Getting quotas for project d6694b9b80564e33be17d249d8b0307a. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:37:39.653437 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Getting quotas for user e03233aa40584b2e9f8527419423ec99 and project d6694b9b80564e33be17d249d8b0307a. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:37:39.721551 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] [instance: f87cef21-29a6-406e-aa73-1839431c3fb1] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:37:39.724509 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:39.728607 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:39.831166 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] [instance: f87cef21-29a6-406e-aa73-1839431c3fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c4cffc7-3a67-4a41-915c-06db6b9c23d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:37:39.834346 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:39.835517 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:40.055738 n-d-779913-11 nova-conductor[99293]: DEBUG nova.scheduler.utils [None req-20654fb3-02fb-4f21-beab-c75a1b324cf2 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] [instance: 4dbb7a7e-2366-4a9e-bd20-f9bf73dff05a] Instance allocations successfully created on destination node a6476fd0-f26b-421b-aa0f-9bdb0ef7b967: {'allocations': {'a6476fd0-f26b-421b-aa0f-9bdb0ef7b967': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99293) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Jun 10 02:37:40.056183 n-d-779913-11 nova-conductor[99293]: DEBUG nova.objects.instance [None req-20654fb3-02fb-4f21-beab-c75a1b324cf2 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lazy-loading 'resources' on Instance uuid 4dbb7a7e-2366-4a9e-bd20-f9bf73dff05a {{(pid=99293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:37:40.062185 n-d-779913-11 nova-conductor[99293]: DEBUG nova.objects.instance [None req-20654fb3-02fb-4f21-beab-c75a1b324cf2 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lazy-loading 'pci_requests' on Instance uuid 4dbb7a7e-2366-4a9e-bd20-f9bf73dff05a {{(pid=99293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:37:40.308732 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:40.309227 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cd7f9ba1-053e-474f-a2e2-b32b0ddd60c3 tempest-AttachSCSIVolumeTestJSON-874822610 tempest-AttachSCSIVolumeTestJSON-874822610-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:41.544207 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.live_migrate [None req-20654fb3-02fb-4f21-beab-c75a1b324cf2 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] [instance: 4dbb7a7e-2366-4a9e-bd20-f9bf73dff05a] Start binding ports on destination host: n-h2-779913-11 {{(pid=99293) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jun 10 02:37:41.878168 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c285f59c-cddd-4e88-a0d4-6903ecfa52e9 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:37:41.879633 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c285f59c-cddd-4e88-a0d4-6903ecfa52e9 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:37:41.883676 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c285f59c-cddd-4e88-a0d4-6903ecfa52e9 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:37:42.455271 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-c285f59c-cddd-4e88-a0d4-6903ecfa52e9 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: 56343a33-9323-4628-9347-50c9d74acf3c] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99294) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 02:37:43.310200 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-c285f59c-cddd-4e88-a0d4-6903ecfa52e9 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Created allocations for migration afcf4564-d862-4030-9277-0fbe9e432003 on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:37:44.081654 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-c285f59c-cddd-4e88-a0d4-6903ecfa52e9 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: 56343a33-9323-4628-9347-50c9d74acf3c] Calling prep_resize with selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [Selection(allocation_request='{"allocations": {"a6476fd0-f26b-421b-aa0f-9bdb0ef7b967": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["a6476fd0-f26b-421b-aa0f-9bdb0ef7b967"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=3a558ffc-c5f1-432a-9dcf-9c326fcb959c,compute_node_uuid=a6476fd0-f26b-421b-aa0f-9bdb0ef7b967,limits=SchedulerLimits,nodename='n-h2-779913-11',service_host='n-h2-779913-11')] {{(pid=99294) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 02:38:07.373568 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-20037cde-dc49-4f12-b165-610efd0baac3 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:38:07.375247 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-20037cde-dc49-4f12-b165-610efd0baac3 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:07.375778 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-20037cde-dc49-4f12-b165-610efd0baac3 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:08.557518 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-20037cde-dc49-4f12-b165-610efd0baac3 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Created allocations for migration efbb32db-8d3b-4b46-a964-81f8e360ba28 on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99293) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:38:08.897248 n-d-779913-11 nova-conductor[99293]: DEBUG nova.scheduler.utils [None req-20037cde-dc49-4f12-b165-610efd0baac3 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] [instance: 5983949d-e81a-49fb-8fd1-cdcfc602fec0] Instance allocations successfully created on destination node a6476fd0-f26b-421b-aa0f-9bdb0ef7b967: {'allocations': {'a6476fd0-f26b-421b-aa0f-9bdb0ef7b967': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99293) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Jun 10 02:38:08.897975 n-d-779913-11 nova-conductor[99293]: DEBUG nova.objects.instance [None req-20037cde-dc49-4f12-b165-610efd0baac3 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lazy-loading 'resources' on Instance uuid 5983949d-e81a-49fb-8fd1-cdcfc602fec0 {{(pid=99293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:38:08.905681 n-d-779913-11 nova-conductor[99293]: DEBUG nova.objects.instance [None req-20037cde-dc49-4f12-b165-610efd0baac3 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lazy-loading 'pci_requests' on Instance uuid 5983949d-e81a-49fb-8fd1-cdcfc602fec0 {{(pid=99293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:38:09.587133 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.live_migrate [None req-20037cde-dc49-4f12-b165-610efd0baac3 tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] [instance: 5983949d-e81a-49fb-8fd1-cdcfc602fec0] Start binding ports on destination host: n-h2-779913-11 {{(pid=99293) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jun 10 02:38:17.508158 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:38:17.547378 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:17.548080 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:17.891831 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:17.893899 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:17.896587 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:17.897368 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:17.926689 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Getting quotas for project 6fb5794e3650437b99681c8d01d06a14. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:38:17.935623 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Getting quotas for user 548ac3f987ad4840b51b9dfcabeb9c06 and project 6fb5794e3650437b99681c8d01d06a14. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:38:17.964954 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] [instance: 08f96ad9-e64d-4529-9db2-6ed11ad0ed0e] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:38:17.966823 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:17.967654 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:18.053088 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] [instance: 08f96ad9-e64d-4529-9db2-6ed11ad0ed0e] block_device_mapping [BlockDeviceMapping(attachment_id=8746b24d-0265-41d4-8514-37bdf21372f9,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8485e82d-7044-4bb8-9c1f-b21d76142904',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=603dda4d-23bb-4cf0-81cb-3afca9ee996e,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2a5d147e-9084-4d6c-b070-27398be8cbb3',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=16214486-d9c9-4aac-9e09-a9c65c344b30,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c81d431-7ed0-4541-8edd-f219fc547022',volume_size=1,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:38:18.055340 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:18.055755 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:18.172940 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:18.176118 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:18.321904 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:18.322865 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:18.480014 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:38:18.516755 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:18.518464 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:18.713027 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:18.713797 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-54d2ec3c-f898-4d46-badb-91a9020e9035 tempest-TaggedBootDevicesTest_v242-643041529 tempest-TaggedBootDevicesTest_v242-643041529-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:18.737288 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:18.739482 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:18.744556 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:18.744556 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:18.761322 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:38:18.768758 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for user af250ecb6a7643cd92b243905597400f and project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:38:18.784324 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 8649b579-75fb-4f6f-b4bc-357b86c9f774] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:38:18.786230 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:18.786856 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:18.881264 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 8649b579-75fb-4f6f-b4bc-357b86c9f774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:38:18.883316 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:18.883951 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:19.183687 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:19.184201 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cfdf4974-7a85-4187-98e8-99c17016ac94 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:37.528622 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:38:38.554458 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36610. Jun 10 02:38:49.191020 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Took 1.07 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:38:49.252067 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:49.252920 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:49.464632 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:49.466482 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:49.471136 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:49.471889 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:49.523802 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Getting quotas for project b38319811afb430e8de0c4249f1a1aa1. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:38:49.529779 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Getting quotas for user de91badf8c9b4abeb8a3368631e71133 and project b38319811afb430e8de0c4249f1a1aa1. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:38:49.548085 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: 934006df-5711-423c-9e36-4d5a655d8df4] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:38:49.550451 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:49.551236 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:49.692794 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] [instance: 934006df-5711-423c-9e36-4d5a655d8df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:38:49.694990 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:49.695465 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:50.080090 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:50.080637 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-145b91fa-1fef-41ad-85eb-2a1523332cc6 tempest-MigrationsAdminTest-1452946642 tempest-MigrationsAdminTest-1452946642-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:54.506061 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:38:54.534256 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:54.534693 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:54.918376 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:54.919178 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:54.920472 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:54.921689 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:54.959652 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Getting quotas for project 01297ba67f354927aa4411438f396bb0. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:38:54.981192 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Getting quotas for user 452696b168fb4833866ff1a5b08ffb32 and project 01297ba67f354927aa4411438f396bb0. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:38:55.000219 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] [instance: 375ded02-f81d-425b-b34f-54e66a42a633] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:38:55.003518 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:55.004483 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:55.140367 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] [instance: 375ded02-f81d-425b-b34f-54e66a42a633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:38:55.143809 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:55.144709 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:38:55.490477 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:38:55.491036 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-85b84d80-3a98-43d9-b6ad-43e613739c9b tempest-ServerTagsTestJSON-2146159001 tempest-ServerTagsTestJSON-2146159001-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:04.982152 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:39:05.121758 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:05.122248 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:05.270845 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:05.275453 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:05.276956 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:05.278222 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:05.330451 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:39:05.342121 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for user af250ecb6a7643cd92b243905597400f and project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:39:05.377660 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 9c71a072-d0f6-4967-acb2-630b494402f2] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:39:05.378692 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:05.379159 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:05.495934 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: 9c71a072-d0f6-4967-acb2-630b494402f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:39:05.497285 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:05.497702 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:05.821669 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:05.822455 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7e827eaa-6558-4447-aeb0-82d1f098ecb5 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:20.106154 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:39:20.173128 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:20.175558 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:20.508955 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:20.509543 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:20.510474 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:20.510992 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:20.530487 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Getting quotas for project 38087d187480432e986b0fad794be7de. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:39:20.536743 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Getting quotas for user 04589bf082f3490889ceb8f1ed7cb811 and project 38087d187480432e986b0fad794be7de. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:39:20.550289 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] [instance: 525f49f8-2719-4e98-93b2-c641e11a47cb] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:39:20.551381 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:20.551858 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:20.641020 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] [instance: 525f49f8-2719-4e98-93b2-c641e11a47cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:39:20.643910 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:20.644751 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:21.060959 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:21.061380 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-df29dbf6-cd97-46d9-a7b0-1a3b23a7af88 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:22.403919 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-bd21be8f-d944-492b-a4e9-85957a8fcd77 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:39:22.407213 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bd21be8f-d944-492b-a4e9-85957a8fcd77 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:22.408073 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bd21be8f-d944-492b-a4e9-85957a8fcd77 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:22.882560 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-bd21be8f-d944-492b-a4e9-85957a8fcd77 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] [instance: 934006df-5711-423c-9e36-4d5a655d8df4] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99294) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 02:39:23.598461 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:39:23.633094 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:23.633796 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:23.822283 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:23.823175 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:23.824549 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:23.825280 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:23.852180 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Getting quotas for project 38087d187480432e986b0fad794be7de. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:39:23.859670 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Getting quotas for user 04589bf082f3490889ceb8f1ed7cb811 and project 38087d187480432e986b0fad794be7de. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:39:23.872756 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-bd21be8f-d944-492b-a4e9-85957a8fcd77 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] Created allocations for migration 7ffe5dc4-7764-4e56-ac81-690d947f325e on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:39:23.875854 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] [instance: 35573a2b-a613-48ce-b2ba-05461678503a] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:39:23.876943 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:23.877519 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:23.975159 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] [instance: 35573a2b-a613-48ce-b2ba-05461678503a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:39:23.976665 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:23.978234 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:24.329712 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:24.330439 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-849ed0a6-41aa-4a31-ad7b-05b2d7a64c53 tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:24.425165 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-bd21be8f-d944-492b-a4e9-85957a8fcd77 tempest-MigrationsAdminTest-905977892 tempest-MigrationsAdminTest-905977892-project-admin] [instance: 934006df-5711-423c-9e36-4d5a655d8df4] Calling prep_resize with selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99294) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 02:39:45.147390 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:39:45.211904 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:45.212664 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:45.450927 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:45.453834 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:45.458672 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:45.459567 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:45.481636 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:39:45.489105 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Getting quotas for user af250ecb6a7643cd92b243905597400f and project 54764840d8914e8594da87c16f173881. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:39:45.502740 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: ab174382-309a-4f63-a08e-03ab1d61d077] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:39:45.504047 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:45.504695 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:45.613533 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] [instance: ab174382-309a-4f63-a08e-03ab1d61d077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:39:45.614980 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:45.615628 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:39:45.987512 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:39:45.988195 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1b2f61c5-3d3a-497d-8fd3-487b891ff396 tempest-ServersOnMultiNodesTest-1571440321 tempest-ServersOnMultiNodesTest-1571440321-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:00.256660 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:40:00.300222 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:00.302973 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:00.544064 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:00.545292 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:00.548343 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:00.549396 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:00.685124 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Getting quotas for project 38087d187480432e986b0fad794be7de. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:40:00.703709 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Getting quotas for user 04589bf082f3490889ceb8f1ed7cb811 and project 38087d187480432e986b0fad794be7de. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:40:00.727963 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] [instance: fafb8942-a0cc-4ca6-98b6-5841d7fb670c] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:40:00.729866 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:00.730986 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:00.837678 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] [instance: fafb8942-a0cc-4ca6-98b6-5841d7fb670c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:40:00.839404 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:00.839810 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:01.168116 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:01.168553 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a75e4021-359a-4c29-8f9f-bab50b895a4e tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:05.760282 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:40:05.821334 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:05.826412 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:06.023018 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:06.024318 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:06.472360 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:06.472360 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:06.472360 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Getting quotas for project b95a4e41a0e24a96acf9488e20b25566. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:40:06.472360 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Getting quotas for user 66c535d115d04bfbbc33ea3f15d2910a and project b95a4e41a0e24a96acf9488e20b25566. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:40:06.477068 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] [instance: 35e4f2ea-3660-4ffa-8222-487439650de3] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:40:06.477068 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:06.477068 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:06.521229 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] [instance: 35e4f2ea-3660-4ffa-8222-487439650de3] block_device_mapping [BlockDeviceMapping(attachment_id=3a63faea-4074-4a2b-a2dd-4fba98e62d78,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a155b820-0a17-408f-a639-fe6e30fb271c',volume_size=1,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:40:06.521928 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:06.522665 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:06.902848 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:06.906362 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f07d3df8-fe58-4b81-a4b0-683ec5414027 tempest-LiveAutoBlockMigrationV225Test-176740034 tempest-LiveAutoBlockMigrationV225Test-176740034-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:17.293901 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:40:18.205165 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:40:18.238747 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:18.239256 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:18.345028 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37958. Jun 10 02:40:18.494431 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:18.494794 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:18.495758 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:18.496151 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:18.521211 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:40:18.528800 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for user b9d02d72c5ba4189b92612429b34e5ff and project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:40:18.547648 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: 335110a5-3bd3-4406-be37-f18dc375c54f] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:40:18.549819 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:18.549819 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:18.738447 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: 335110a5-3bd3-4406-be37-f18dc375c54f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:40:18.741959 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:18.743090 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:19.593967 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:19.594894 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-502519d9-440c-478c-b6f5-f453431baa78 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:42.330307 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-acbc8336-a20c-471a-ad79-4b6c5f8932f6 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:40:42.331148 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-acbc8336-a20c-471a-ad79-4b6c5f8932f6 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:42.331823 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-acbc8336-a20c-471a-ad79-4b6c5f8932f6 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:43.505112 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-acbc8336-a20c-471a-ad79-4b6c5f8932f6 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Created allocations for migration fc2cb6e3-11a8-454a-bf35-ff7142d448f5 on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:40:44.140994 n-d-779913-11 nova-conductor[99294]: DEBUG nova.scheduler.utils [None req-acbc8336-a20c-471a-ad79-4b6c5f8932f6 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] [instance: 35e4f2ea-3660-4ffa-8222-487439650de3] Instance allocations successfully created on destination node a6476fd0-f26b-421b-aa0f-9bdb0ef7b967: {'allocations': {'a6476fd0-f26b-421b-aa0f-9bdb0ef7b967': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=99294) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Jun 10 02:40:44.142725 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-acbc8336-a20c-471a-ad79-4b6c5f8932f6 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lazy-loading 'resources' on Instance uuid 35e4f2ea-3660-4ffa-8222-487439650de3 {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:40:44.152277 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-acbc8336-a20c-471a-ad79-4b6c5f8932f6 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] Lazy-loading 'pci_requests' on Instance uuid 35e4f2ea-3660-4ffa-8222-487439650de3 {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:40:46.088813 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.live_migrate [None req-acbc8336-a20c-471a-ad79-4b6c5f8932f6 tempest-LiveAutoBlockMigrationV225Test-70886930 tempest-LiveAutoBlockMigrationV225Test-70886930-project-admin] [instance: 35e4f2ea-3660-4ffa-8222-487439650de3] Start binding ports on destination host: n-h2-779913-11 {{(pid=99294) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jun 10 02:40:47.924668 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:40:48.064107 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:48.064617 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:48.443915 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:48.445964 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:48.450651 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:48.451492 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:48.510526 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Getting quotas for project 2b74596473364f4585b3fa38d6b3dc8e. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:40:48.518028 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Getting quotas for user d248ffa8416045038cfab0a4f8a11777 and project 2b74596473364f4585b3fa38d6b3dc8e. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:40:48.535980 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] [instance: 857df664-499b-437a-9cbd-4f93e63a3764] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:40:48.537605 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:48.538389 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:48.615825 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] [instance: 857df664-499b-437a-9cbd-4f93e63a3764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:40:48.617484 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:48.618110 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:48.950745 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:48.951920 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-00b5257f-645c-4183-b34a-3b31e7aeeb2a tempest-FloatingIPsAssociationNegativeTestJSON-1345079073 tempest-FloatingIPsAssociationNegativeTestJSON-1345079073-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:52.078336 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:40:52.147065 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:52.147626 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:52.351728 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:52.352315 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:52.353559 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:52.354316 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:52.375958 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:40:52.382358 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for user b9d02d72c5ba4189b92612429b34e5ff and project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:40:52.396835 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: ed03c741-f719-4874-b777-79db1fc6d591] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:40:52.404942 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:52.404942 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:52.484559 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: ed03c741-f719-4874-b777-79db1fc6d591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:40:52.486261 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:52.487188 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:52.823200 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:52.823877 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e1352f4-0175-4194-8acb-0c65cfe634c8 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:55.604634 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:40:55.661297 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:55.667689 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:55.834505 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:55.834960 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:55.836300 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:55.836300 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:55.870661 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Getting quotas for project cddc729c61334cfd8ce41b8d709a5a5c. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:40:55.878369 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Getting quotas for user b17e5766981445ff914601fa25380ca7 and project cddc729c61334cfd8ce41b8d709a5a5c. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:40:55.894903 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] [instance: 442f4b89-7596-49b0-a99c-e5f24babd5fe] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:40:55.896009 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:55.896681 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:55.983569 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] [instance: 442f4b89-7596-49b0-a99c-e5f24babd5fe] block_device_mapping [BlockDeviceMapping(attachment_id=bf7e1e28-cdde-4b13-aade-45501a9a5dc5,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20741e93-1e13-4db6-90e4-e4e7461ab347',volume_size=1,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:40:55.985259 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:55.985857 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:40:56.286074 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:40:56.286480 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-93330402-3a77-41d3-8735-210338ae5206 tempest-LiveMigrationTest-2096156363 tempest-LiveMigrationTest-2096156363-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:05.768019 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Took 1.09 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:41:05.819990 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:05.820430 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:06.066470 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:06.067698 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:06.068827 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:06.069563 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:06.124952 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:41:06.131656 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for user b9d02d72c5ba4189b92612429b34e5ff and project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:41:06.145263 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: 94e65649-afd3-4bdc-93c4-8de7a70ff406] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:41:06.146595 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:06.147226 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:06.313774 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: 94e65649-afd3-4bdc-93c4-8de7a70ff406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:41:06.321522 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:06.321522 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:06.788200 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:06.788200 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3b23b401-504c-4841-893e-504f4fa2041b tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:07.176490 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-3967f119-859e-4095-95f2-d30f9de256ce tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method rebuild_instance {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:41:07.179386 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3967f119-859e-4095-95f2-d30f9de256ce tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:07.180404 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3967f119-859e-4095-95f2-d30f9de256ce tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:07.347005 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-3967f119-859e-4095-95f2-d30f9de256ce tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] [instance: 525f49f8-2719-4e98-93b2-c641e11a47cb] No migration record for the rebuild/evacuate request. {{(pid=99293) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jun 10 02:41:32.035687 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-84255073-c7e6-4617-88e1-3705ef51249a tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:41:32.036321 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-84255073-c7e6-4617-88e1-3705ef51249a tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:32.036589 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-84255073-c7e6-4617-88e1-3705ef51249a tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:32.859917 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-84255073-c7e6-4617-88e1-3705ef51249a tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Created allocations for migration 8da20ff8-d9e4-4454-8540-12f70e125922 on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 02:41:33.288401 n-d-779913-11 nova-conductor[99294]: DEBUG nova.scheduler.utils [None req-84255073-c7e6-4617-88e1-3705ef51249a tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] [instance: 442f4b89-7596-49b0-a99c-e5f24babd5fe] Instance allocations successfully created on destination node a6476fd0-f26b-421b-aa0f-9bdb0ef7b967: {'allocations': {'a6476fd0-f26b-421b-aa0f-9bdb0ef7b967': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=99294) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Jun 10 02:41:33.290595 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-84255073-c7e6-4617-88e1-3705ef51249a tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lazy-loading 'resources' on Instance uuid 442f4b89-7596-49b0-a99c-e5f24babd5fe {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:41:33.300664 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-84255073-c7e6-4617-88e1-3705ef51249a tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] Lazy-loading 'pci_requests' on Instance uuid 442f4b89-7596-49b0-a99c-e5f24babd5fe {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:41:34.205410 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.live_migrate [None req-84255073-c7e6-4617-88e1-3705ef51249a tempest-LiveMigrationTest-394907350 tempest-LiveMigrationTest-394907350-project-admin] [instance: 442f4b89-7596-49b0-a99c-e5f24babd5fe] Start binding ports on destination host: n-h2-779913-11 {{(pid=99294) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jun 10 02:41:42.764478 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-750c6a97-7a6c-43d8-bcc3-db39e010655b tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method rebuild_instance {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:41:42.771519 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-750c6a97-7a6c-43d8-bcc3-db39e010655b tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:42.774454 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-750c6a97-7a6c-43d8-bcc3-db39e010655b tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:42.918197 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-750c6a97-7a6c-43d8-bcc3-db39e010655b tempest-ServersAdminTestJSON-548437881 tempest-ServersAdminTestJSON-548437881-project] [instance: 525f49f8-2719-4e98-93b2-c641e11a47cb] No migration record for the rebuild/evacuate request. {{(pid=99293) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jun 10 02:41:50.062250 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:41:50.121992 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:50.122600 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:50.425616 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:50.426709 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:50.428909 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:50.430041 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:50.513620 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:41:50.526992 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for user b9d02d72c5ba4189b92612429b34e5ff and project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:41:50.581649 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: 1c7b9853-b1bc-4a6e-a659-ed1142856593] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:41:50.584768 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:50.585659 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:50.706109 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: 1c7b9853-b1bc-4a6e-a659-ed1142856593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:41:50.713812 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:50.713812 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:41:51.187982 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:41:51.188772 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-0e62fdf2-f164-499e-aa78-34da16412673 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:38.990472 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Took 1.27 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:42:39.062768 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:39.063360 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:39.234583 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:39.240454 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:39.240454 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:39.240454 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:39.257451 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:42:39.264095 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for user b9d02d72c5ba4189b92612429b34e5ff and project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:42:39.278444 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: 5d860b9c-8ae2-4918-b34d-8964614d6358] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:42:39.280486 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:39.280907 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:39.396503 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: 5d860b9c-8ae2-4918-b34d-8964614d6358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:42:39.397958 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:39.398371 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:39.796947 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:39.797621 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e4d8614c-653a-4af3-95a2-31ee0f0275c3 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:40.993067 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:42:41.049611 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:41.050422 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:41.288896 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:41.289641 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:41.293193 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:41.296464 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:41.321065 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Getting quotas for project 3fb3c0fb01dd40879058b6cd2d30bee9. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:42:41.352256 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Getting quotas for user 802500c77f7947fa9a0f3552101f9296 and project 3fb3c0fb01dd40879058b6cd2d30bee9. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:42:41.382644 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] [instance: 6007b460-5cbf-4052-aca5-24b36a447865] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:42:41.385313 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:41.392961 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:41.481872 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] [instance: 6007b460-5cbf-4052-aca5-24b36a447865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:42:41.483765 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:41.484296 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:42:41.955337 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:42:41.957485 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4afed8f3-f286-43e0-a28d-9c4b9d988948 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:10.885804 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:43:10.926279 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:10.926690 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:11.118795 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:11.119966 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:11.121504 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:11.121670 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:11.146911 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:43:11.151922 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for user b9d02d72c5ba4189b92612429b34e5ff and project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:43:11.164664 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: d1e4980e-fc12-48e5-bad6-87c4bd32ef7e] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:43:11.165622 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:11.166209 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:11.290328 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: d1e4980e-fc12-48e5-bad6-87c4bd32ef7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:43:11.292347 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:11.293013 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:11.817408 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:11.818876 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c3003ecd-dc67-460a-9afd-f7dd0546a37a tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:13.096919 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:43:13.149508 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:13.150296 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:13.549102 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:13.552576 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:13.559182 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:13.559952 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:13.627817 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Getting quotas for project 3f773be12308435a96dcff1f95166b3c. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:43:13.636220 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Getting quotas for user 0fdf092a9d9948f08371c5cb5c4c7749 and project 3f773be12308435a96dcff1f95166b3c. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:43:13.654746 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] [instance: f6cf8f81-9414-4a14-991e-33c2c996c1bc] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:43:13.664658 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:13.664658 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:13.927334 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] [instance: f6cf8f81-9414-4a14-991e-33c2c996c1bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:43:13.927819 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:13.930150 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:14.584115 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:14.587292 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-31a27626-4404-4ba1-8c25-346fbb828dc0 tempest-ImagesOneServerTestJSON-1468149180 tempest-ImagesOneServerTestJSON-1468149180-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:18.343794 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:43:19.365449 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40524. Jun 10 02:43:21.579451 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:43:21.617840 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:21.618574 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:21.759798 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:21.760459 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:21.761177 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:21.761565 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:21.778832 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Getting quotas for project 3fb3c0fb01dd40879058b6cd2d30bee9. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:43:21.786718 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Getting quotas for user 802500c77f7947fa9a0f3552101f9296 and project 3fb3c0fb01dd40879058b6cd2d30bee9. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:43:21.802038 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] [instance: c08dbafd-0125-4ad7-8638-8b79eba4c64c] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:43:21.803060 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:21.803589 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:21.880579 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] [instance: c08dbafd-0125-4ad7-8638-8b79eba4c64c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:43:21.883330 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:21.883330 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:22.173573 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:22.174290 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9142005e-dbdb-46f8-ba61-52385273bf90 tempest-FloatingIPsAssociationTestJSON-1364533710 tempest-FloatingIPsAssociationTestJSON-1364533710-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:27.786620 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:43:27.916016 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:27.917131 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:28.245388 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:28.247935 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:28.251290 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:28.251932 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:28.272471 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Getting quotas for project 89899d66c97248fda5ee9d10e4dc8b2e. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:43:28.283341 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Getting quotas for user b0fd16aaffc0406dbd8dd2ef6e69b440 and project 89899d66c97248fda5ee9d10e4dc8b2e. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:43:28.316818 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] [instance: 81f9a8c5-28a6-4865-89b0-1e23beee1772] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:43:28.318236 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:28.320383 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:28.446039 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] [instance: 81f9a8c5-28a6-4865-89b0-1e23beee1772] block_device_mapping [BlockDeviceMapping(attachment_id=9f8bb344-d621-4181-bafe-1e02e6d521b7,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8180284a-4f3e-4fc9-bf60-646c10dc458c',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=d3a37f0d-bc31-4c18-a5a5-59e1534d1b5e,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='860f61f8-9ec5-4836-82b1-7b6e15a120f5',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=be8ef1ae-cb22-4560-b45f-fc3b510d6310,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40849dd1-ba98-46c9-803a-ba99494a8fb4',volume_size=1,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:43:28.448853 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:28.448853 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:28.573018 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:28.578067 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:28.680987 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:28.681462 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:28.942174 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:43:28.978568 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:28.978568 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:29.009678 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:29.009678 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a28eb08b-c965-4573-a84d-a8ada8f0e82f tempest-TaggedBootDevicesTest-292642576 tempest-TaggedBootDevicesTest-292642576-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:29.238376 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:29.238785 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:29.239561 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:29.240012 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:29.268800 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Getting quotas for project 3cfdb804fe9c465cad432b59978757e2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:43:29.274159 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Getting quotas for user 35222019af30483b9d5dea1d2c81b05f and project 3cfdb804fe9c465cad432b59978757e2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:43:29.285842 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] [instance: 7e553f83-3475-417a-8254-b9f29bec5637] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:43:29.286784 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:29.287434 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:29.377422 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] [instance: 7e553f83-3475-417a-8254-b9f29bec5637] block_device_mapping [BlockDeviceMapping(attachment_id=33691a05-4bbe-45ca-ab6d-3ea36188a3b6,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6bd06e6b-7893-4542-af47-183ae0478c61',volume_size=1,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:43:29.379027 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:29.379903 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:29.644165 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:43:29.644679 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ba94c284-23ad-4aea-95f2-e016185e7d43 tempest-ServersTestBootFromVolume-320094519 tempest-ServersTestBootFromVolume-320094519-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:43:38.556185 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:43:39.588108 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40736. Jun 10 02:44:10.912927 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:44:10.946166 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:10.947217 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:11.135591 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:11.136533 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:11.137537 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:11.138149 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:11.157786 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:44:11.163516 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for user b9d02d72c5ba4189b92612429b34e5ff and project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:44:11.185008 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: f224f2bb-d7de-4094-9874-61b97da256cb] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:44:11.185973 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:11.186379 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:11.247096 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: f224f2bb-d7de-4094-9874-61b97da256cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:44:11.248703 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:11.249108 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:11.559890 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:11.560296 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-289bea62-bd79-40d9-91b2-ce86e6227fdc tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:27.407519 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 02:44:47.360019 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:44:47.417104 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:47.420258 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:47.550080 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:47.550715 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:47.551678 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:47.552851 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:47.583879 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:44:47.591189 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Getting quotas for user b9d02d72c5ba4189b92612429b34e5ff and project 32ab8db5239b46208375928fb3e62a1d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:44:47.609807 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: f078466e-d853-4778-839c-c199419f35e8] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:44:47.611506 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:47.612950 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:47.674118 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] [instance: f078466e-d853-4778-839c-c199419f35e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:44:47.676199 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:47.676744 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:44:47.969002 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:44:47.969452 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b93bbc6f-5739-44e2-ac04-90253fb45634 tempest-ServersTestJSON-707929584 tempest-ServersTestJSON-707929584-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:04.665368 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:45:04.713214 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:04.713631 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:05.141181 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:05.141638 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:05.142474 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:05.145272 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:05.179338 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Getting quotas for project ba21d44f48e74c1e9480f7e7f1cd91ac. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:45:05.186657 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Getting quotas for user 562b29437a2c4292a0341dd892bb5fdc and project ba21d44f48e74c1e9480f7e7f1cd91ac. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:45:05.236669 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] [instance: 63fa0a18-c9fc-4234-ba78-b30edaeec1ed] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:45:05.241461 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:05.243657 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:05.427144 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] [instance: 63fa0a18-c9fc-4234-ba78-b30edaeec1ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:45:05.440286 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:05.443911 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:05.992135 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:05.992135 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-569013ba-2da8-476a-8cf1-572ceea0ad4f tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:21.914830 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Took 0.98 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:45:21.943678 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:21.944615 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:22.276634 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:22.277265 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:22.278168 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:22.278749 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:22.328362 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Getting quotas for project 3fd17e81fed4405da25820a5778b37e1. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:45:22.340574 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Getting quotas for user d365a04f26784d8f94c55db13d2db68f and project 3fd17e81fed4405da25820a5778b37e1. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:45:22.351667 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] [instance: b7cff6df-c2b3-4203-b497-d7f24d5425a3] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:45:22.352968 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:22.353379 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:22.453033 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] [instance: b7cff6df-c2b3-4203-b497-d7f24d5425a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:45:22.459852 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:22.459852 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:22.821355 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:22.821773 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6c792018-179e-4b2f-9a39-9f9cdfd0ffc8 tempest-ServersTestJSON-1988491284 tempest-ServersTestJSON-1988491284-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:28.989585 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:45:29.049960 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:29.053491 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:29.396993 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:29.397324 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:29.398063 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:29.399228 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:29.447291 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Getting quotas for project 1640b27e23e34e50b6016238f617da94. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:45:29.457513 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Getting quotas for user 4bd783eabe2c4b2e825ec21527ba175f and project 1640b27e23e34e50b6016238f617da94. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:45:29.488051 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] [instance: 1678084a-427f-4d8e-8093-d863b4e78f72] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:45:29.489032 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:29.489444 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:29.615272 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] [instance: 1678084a-427f-4d8e-8093-d863b4e78f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:45:29.615272 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:29.615272 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:29.929596 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:45:29.959838 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:29.959838 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6cc89735-caac-490b-90ab-873dc25a0785 tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:29.966668 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:29.967473 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:30.123047 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:30.124241 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:30.126136 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:30.126690 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:30.145003 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Getting quotas for project 1640b27e23e34e50b6016238f617da94. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:45:30.149476 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Getting quotas for user 4bd783eabe2c4b2e825ec21527ba175f and project 1640b27e23e34e50b6016238f617da94. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:45:30.163199 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] [instance: 7d353625-fa71-4a43-ba03-88b360af16db] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:45:30.164759 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:30.164992 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:30.223458 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] [instance: 7d353625-fa71-4a43-ba03-88b360af16db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:45:30.224704 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:30.225106 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:30.592727 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:30.593143 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-21ac4b78-f217-4b7a-9a39-db48ca84050b tempest-ListImageFiltersTestJSON-1728900829 tempest-ListImageFiltersTestJSON-1728900829-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:34.528860 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:45:34.576663 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:34.577773 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:34.833739 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:34.834155 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:34.835701 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:34.836330 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:34.873115 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Getting quotas for project d8b89187053e484fa13c5305fff200ed. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:45:34.892983 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Getting quotas for user fd52fc66f088415a847fec1db477ccda and project d8b89187053e484fa13c5305fff200ed. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:45:34.913816 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] [instance: 3a2ed1a8-fed1-4d5e-9e22-d269d0cc625e] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:45:34.914797 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:34.915406 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:35.028076 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] [instance: 3a2ed1a8-fed1-4d5e-9e22-d269d0cc625e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:45:35.028076 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:35.028076 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:35.381088 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:35.381565 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-540723f6-68e8-416c-a308-9546a9cdbed1 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:58.347251 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:45:58.390520 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:58.392176 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:58.576545 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:58.576948 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:58.577932 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:58.578657 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:58.595504 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Getting quotas for project ba21d44f48e74c1e9480f7e7f1cd91ac. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:45:58.600433 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Getting quotas for user 562b29437a2c4292a0341dd892bb5fdc and project ba21d44f48e74c1e9480f7e7f1cd91ac. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:45:58.612522 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] [instance: a399707c-bfc1-4487-8596-9939ed74261c] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:45:58.613652 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:58.614060 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:58.677385 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] [instance: a399707c-bfc1-4487-8596-9939ed74261c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:45:58.679794 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:58.680810 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:45:58.929370 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:45:58.930609 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-28668fb0-1544-4660-b98c-82780692e7cb tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:46:19.364901 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:46:20.386669 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44374. Jun 10 02:46:21.060953 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:46:21.085710 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:46:21.086129 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:46:21.295294 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:46:21.295713 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:46:21.296483 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:46:21.296902 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:46:21.317483 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Getting quotas for project d8b89187053e484fa13c5305fff200ed. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:46:21.322182 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Getting quotas for user fd52fc66f088415a847fec1db477ccda and project d8b89187053e484fa13c5305fff200ed. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:46:21.333992 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] [instance: c1bdd378-9dbf-4c70-8226-3c1574952f13] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:46:21.334962 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:46:21.335436 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:46:21.422306 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] [instance: c1bdd378-9dbf-4c70-8226-3c1574952f13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:46:21.423520 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:46:21.423925 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:46:21.815937 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:46:21.816619 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-bcb83de9-e72a-492d-907a-812a7395aaaa tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:46:39.586500 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:46:40.619671 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 45036. Jun 10 02:47:03.976503 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:47:04.047254 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:04.047254 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:04.276853 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:04.277789 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:04.279324 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:04.280153 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:04.348087 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Getting quotas for project d8b89187053e484fa13c5305fff200ed. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:47:04.362588 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Getting quotas for user fd52fc66f088415a847fec1db477ccda and project d8b89187053e484fa13c5305fff200ed. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:47:04.390019 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] [instance: f2a5fa4a-2ed7-4e8d-b716-0773539b0459] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:47:04.392121 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:04.393009 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:04.557683 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] [instance: f2a5fa4a-2ed7-4e8d-b716-0773539b0459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:47:04.560897 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:04.562633 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:04.815846 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:47:04.843972 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:04.844263 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:05.022635 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:05.023186 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9da50e2b-5586-4c62-83cc-d3bee8ffa623 tempest-ImagesOneServerNegativeTestJSON-110984697 tempest-ImagesOneServerNegativeTestJSON-110984697-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:05.091690 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:05.093787 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:05.095738 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:05.097246 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:05.119565 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Getting quotas for project ba21d44f48e74c1e9480f7e7f1cd91ac. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:47:05.125027 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Getting quotas for user 562b29437a2c4292a0341dd892bb5fdc and project ba21d44f48e74c1e9480f7e7f1cd91ac. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:47:05.140221 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] [instance: ecf73479-3efa-4c32-9f1e-ad704fb34d07] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:47:05.141616 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:05.142250 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:05.288057 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] [instance: ecf73479-3efa-4c32-9f1e-ad704fb34d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:47:05.289721 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:05.290458 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:05.832910 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:05.835924 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d92fb94-d774-4bb3-bd03-9c4591d5fdf7 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:46.584212 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Took 1.24 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:47:46.611953 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:46.612359 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:46.819674 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:46.819674 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:46.819674 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:46.819674 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:46.842431 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:47:46.848402 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for user 5e64feaee22c4cdaafa9740a71fa4f31 and project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:47:46.865274 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: f3dbd824-3673-4054-99d8-887853ff435b] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:47:46.869531 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:46.869531 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:46.980698 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: f3dbd824-3673-4054-99d8-887853ff435b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:47:46.984336 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:46.984336 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:47.295782 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:47:47.297117 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ebef4a0d-4729-4c81-b916-0665d24d71b4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:47:47.430915 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 02:48:00.289473 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:48:00.380597 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:00.381826 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:00.588379 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:00.589489 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:00.590866 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:00.591862 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:00.615451 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Getting quotas for project ba21d44f48e74c1e9480f7e7f1cd91ac. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:48:00.624541 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Getting quotas for user 562b29437a2c4292a0341dd892bb5fdc and project ba21d44f48e74c1e9480f7e7f1cd91ac. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:48:00.646624 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] [instance: 7fbca114-3b93-45a8-b460-8c37fe0bb59c] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:48:00.648120 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:00.648973 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:00.757619 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] [instance: 7fbca114-3b93-45a8-b460-8c37fe0bb59c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:48:00.760243 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:00.760915 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:01.165943 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:01.166551 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-39e22694-4da6-4fdd-a564-7c3f81819b60 tempest-ImagesTestJSON-865907655 tempest-ImagesTestJSON-865907655-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:19.973678 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:48:20.000439 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:20.005558 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:20.260163 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:20.260708 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:20.264065 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:20.264928 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:20.324814 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:48:20.336403 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for user 5e64feaee22c4cdaafa9740a71fa4f31 and project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:48:20.361139 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: 6413823a-0a69-41ce-9141-057eb7909112] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:48:20.362781 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:20.363803 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:20.436220 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: 6413823a-0a69-41ce-9141-057eb7909112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:48:20.438091 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:20.438558 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:20.821414 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:20.822793 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1f113e7a-c70a-4cec-bec3-632dd40d89a4 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:47.895931 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:48:47.943278 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:47.943906 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:48.256412 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:48.256817 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:48.257713 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:48.258874 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:48.280515 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Getting quotas for project b5e93b554e3a40a98db98c4576f070fc. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:48:48.287675 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Getting quotas for user 963ad2f492c24dbeb3e57bce7409efdc and project b5e93b554e3a40a98db98c4576f070fc. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:48:48.301606 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] [instance: 465438e2-1a27-4aa0-95c5-3939e3c75190] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:48:48.303012 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:48.303573 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:48.405950 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] [instance: 465438e2-1a27-4aa0-95c5-3939e3c75190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:48:48.407899 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:48.408504 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:48:48.786514 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:48:48.787216 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4bb13f78-ea99-4873-b0bf-1dc855f7b626 tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:00.339254 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:49:00.372406 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:00.373041 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:00.644330 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:00.644742 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:00.646186 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:00.646778 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:00.672643 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Getting quotas for project 3dcaa69e192b4fcfb49fb5c7db0de488. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:49:00.681890 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Getting quotas for user a81448268e9449c89d2be537764a0b69 and project 3dcaa69e192b4fcfb49fb5c7db0de488. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:49:00.703105 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] [instance: 19606a04-574b-407f-bbda-7d21f1e88c7e] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:49:00.704752 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:00.705311 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:00.779584 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] [instance: 19606a04-574b-407f-bbda-7d21f1e88c7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:49:00.781063 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:00.781596 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:01.097075 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:01.097492 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7320afb0-c12f-4e76-8850-d098e7776976 tempest-ServerMetadataNegativeTestJSON-332430410 tempest-ServerMetadataNegativeTestJSON-332430410-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:04.872261 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:49:04.918349 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:04.918869 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:05.182059 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:05.182523 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:05.183652 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:05.184150 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:05.214051 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Getting quotas for project ebf1857bac2844468ca504f4d7320399. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:49:05.225956 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Getting quotas for user bf57b99a09f5460bab843140014b2e85 and project ebf1857bac2844468ca504f4d7320399. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:49:05.241006 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] [instance: 165cfae6-f51f-4ed5-b9a2-3b546fe503d5] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:49:05.242326 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:05.243427 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:05.333641 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] [instance: 165cfae6-f51f-4ed5-b9a2-3b546fe503d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:49:05.336872 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:05.337848 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:05.693841 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:05.694567 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d08a0fc4-c637-4c29-b583-f90b2f0074ab tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:20.386330 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 02:49:21.417770 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49106. Jun 10 02:49:22.597636 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:49:22.640479 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:22.641392 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:22.875790 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:22.876769 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:22.880852 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:22.880852 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:22.914248 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:49:22.926245 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for user 5e64feaee22c4cdaafa9740a71fa4f31 and project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:49:22.955561 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: dde0f4f4-5405-4364-8594-211987af1635] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:49:22.957682 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:22.958562 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:23.034688 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: dde0f4f4-5405-4364-8594-211987af1635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:49:23.042242 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:23.043745 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:23.248517 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:23.249070 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:23.500305 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:23.500888 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea4d42a2-e67a-47ab-b3cc-2b962e172aa0 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:26.680922 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:49:26.759458 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:26.763964 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:26.943393 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:26.944180 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:26.945845 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:26.946455 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:26.985305 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:49:26.992440 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for user 5e64feaee22c4cdaafa9740a71fa4f31 and project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:49:27.028261 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: f56f5009-64c0-4c97-9770-50de6d44cb3f] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:49:27.030391 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:27.033162 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:27.147678 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: f56f5009-64c0-4c97-9770-50de6d44cb3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:49:27.153201 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:27.154039 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:27.399213 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:27.399855 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7dc3a271-70b3-4729-a216-ad0a3f6bdc8a tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:40.607680 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:49:41.637510 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49446. Jun 10 02:49:46.582409 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:49:46.626654 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:46.627914 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:46.940541 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:46.940952 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:46.946739 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:46.947251 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:46.989344 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Getting quotas for project 75177c261b4140429b7de75a5a24ad30. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:49:46.995612 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Getting quotas for user 70e7060f4bf44926a66053e06e0a4fdd and project 75177c261b4140429b7de75a5a24ad30. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:49:47.020029 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] [instance: 8a370da4-509d-4010-b45d-720b8ace54db] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:49:47.023130 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:47.024341 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:47.132700 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] [instance: 8a370da4-509d-4010-b45d-720b8ace54db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:49:47.134668 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:47.135265 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:47.435838 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:47.435838 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4049c633-0981-4dc9-a41c-ea5f6493c97c tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:48.985125 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:49:49.042018 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:49.042596 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:49.291806 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:49.292292 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:49.293020 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:49.293334 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:49.365097 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Getting quotas for project 75177c261b4140429b7de75a5a24ad30. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:49:49.375200 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Getting quotas for user 70e7060f4bf44926a66053e06e0a4fdd and project 75177c261b4140429b7de75a5a24ad30. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:49:49.418281 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] [instance: 881e8c72-cab7-473a-ac37-8b5733e40338] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:49:49.419632 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:49.420199 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:49.515858 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] [instance: 881e8c72-cab7-473a-ac37-8b5733e40338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:49:49.518143 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:49.518629 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:49.817495 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:49.820822 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a61de6ee-6dba-434f-b18a-5cc06e3eb5c3 tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:51.439682 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:49:51.470878 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:51.471566 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:51.691359 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:51.691598 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:51.695315 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:51.697576 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:51.771300 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Getting quotas for project 75177c261b4140429b7de75a5a24ad30. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:49:51.780149 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Getting quotas for user 70e7060f4bf44926a66053e06e0a4fdd and project 75177c261b4140429b7de75a5a24ad30. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:49:51.806627 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] [instance: 36bd3a96-9a7f-4271-9905-5baac21dfec3] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:49:51.808627 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:51.809209 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:51.933057 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] [instance: 36bd3a96-9a7f-4271-9905-5baac21dfec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:49:51.936354 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:51.937860 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:49:52.234454 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:49:52.235327 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-70228631-de70-42a2-9ce7-55525b9f87ad tempest-ListServerFiltersTestJSON-1600005379 tempest-ListServerFiltersTestJSON-1600005379-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:07.397986 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:50:07.439140 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:07.440259 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:07.576315 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:07.576781 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:07.577527 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:07.577992 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:07.603140 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Getting quotas for project ebf1857bac2844468ca504f4d7320399. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:50:07.608383 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Getting quotas for user bf57b99a09f5460bab843140014b2e85 and project ebf1857bac2844468ca504f4d7320399. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:50:07.622630 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] [instance: 2f137185-3459-4d86-b731-6f98b1caf0e2] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:50:07.625884 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:07.626121 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:07.751241 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] [instance: 2f137185-3459-4d86-b731-6f98b1caf0e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:50:07.752657 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:07.753175 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:07.977883 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:07.979680 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f76fc05-5c43-4a3b-b838-f481302e598d tempest-SecurityGroupsTestJSON-1890243041 tempest-SecurityGroupsTestJSON-1890243041-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:13.529543 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:50:13.566746 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:13.568154 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:13.925896 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:13.926602 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:13.930051 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:13.931895 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:14.021882 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Getting quotas for project b23b5a554c944b87a5cddf6df79c81cf. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:50:14.033804 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Getting quotas for user 621fe7c9fcf54056ad530a363cc27bc5 and project b23b5a554c944b87a5cddf6df79c81cf. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:50:14.071130 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] [instance: bd3f1a06-0e64-496f-889e-9ea5b705596e] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:50:14.072415 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:14.074166 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:14.190534 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] [instance: bd3f1a06-0e64-496f-889e-9ea5b705596e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:50:14.192478 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:14.193442 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:14.465040 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:14.465354 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6f6d711a-ebdc-4dc4-be4d-8916cdad95e8 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:15.795146 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:50:15.823833 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:15.824603 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.056973 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Took 1.15 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:50:16.100565 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.103680 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.104672 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.105382 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.125908 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.127397 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.148007 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:50:16.154682 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for user 5e64feaee22c4cdaafa9740a71fa4f31 and project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:50:16.170487 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: 4d9fc905-71dc-4147-8b8e-d0aef49ef14c] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:50:16.171718 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.172340 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.400731 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: 4d9fc905-71dc-4147-8b8e-d0aef49ef14c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:50:16.402597 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.403240 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.471548 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.479109 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.479877 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.480302 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.506651 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Getting quotas for project 3b88da56a59544229bf65eeaf0159729. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:50:16.515289 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Getting quotas for user eca89f5e1d834692b2f0fb7cc64d60cf and project 3b88da56a59544229bf65eeaf0159729. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:50:16.542254 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] [instance: a9601a01-5555-4f19-8322-1efd33a6ae5a] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:50:16.544122 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.544692 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.665292 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] [instance: a9601a01-5555-4f19-8322-1efd33a6ae5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:50:16.666574 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.671162 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.730469 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.731086 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-457b459e-4fef-4df4-9514-8db4cfc8d795 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:16.967447 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:16.968089 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-66472660-457f-40ed-962f-99ab4eb4c600 tempest-ServersTestManualDisk-2113398585 tempest-ServersTestManualDisk-2113398585-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:17.370107 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:50:17.405894 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:17.406303 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:17.589579 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:17.593204 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:17.596225 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:17.597335 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:17.639030 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Getting quotas for project b23b5a554c944b87a5cddf6df79c81cf. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:50:17.646779 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Getting quotas for user 621fe7c9fcf54056ad530a363cc27bc5 and project b23b5a554c944b87a5cddf6df79c81cf. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:50:17.663217 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] [instance: 682fc8ed-9072-47d8-a933-989fcf1d588d] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:50:17.664630 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:17.665356 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:17.725098 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] [instance: 682fc8ed-9072-47d8-a933-989fcf1d588d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:50:17.726614 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:17.734454 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:18.008479 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:18.009125 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-01f8cf9a-2bb4-4827-b3a2-9adcfd1bb854 tempest-ServerRescueNegativeTestJSON-54770249 tempest-ServerRescueNegativeTestJSON-54770249-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:27.207464 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Took 0.96 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:50:27.265139 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:27.265571 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:27.471840 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:27.475517 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:27.476548 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:27.477177 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:27.503766 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Getting quotas for project b5e93b554e3a40a98db98c4576f070fc. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:50:27.515128 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Getting quotas for user 963ad2f492c24dbeb3e57bce7409efdc and project b5e93b554e3a40a98db98c4576f070fc. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:50:27.533582 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] [instance: 585bc02f-91a5-4a17-83db-89ad1e549c35] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:50:27.534778 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:27.535372 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:27.633830 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] [instance: 585bc02f-91a5-4a17-83db-89ad1e549c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:50:27.633830 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:27.633830 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:50:27.913059 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:50:27.913482 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dde7bc91-d706-4b86-9671-a4a86fd4cbba tempest-ServersTestMultiNic-325448326 tempest-ServersTestMultiNic-325448326-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:26.404464 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Took 0.94 seconds to select destinations for 2 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:51:26.453388 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:26.453652 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:26.721280 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:26.722096 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:26.900488 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:26.901150 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:26.902182 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:26.902725 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:26.921025 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Getting quotas for project 1a849b548b2741a795274f569ccbb3db. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:51:26.926760 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Getting quotas for user 77307b5b46be4f77bc36beb1427557d9 and project 1a849b548b2741a795274f569ccbb3db. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:51:26.937898 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] [instance: 38a17cda-2194-4350-888d-bf40b5a5bb6d] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:51:26.939205 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:26.939766 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:27.060811 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] [instance: 38a17cda-2194-4350-888d-bf40b5a5bb6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:51:27.064477 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:27.065409 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:27.498301 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:27.499651 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:27.525627 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] [instance: 56a6dd87-3a3c-4997-a81a-35a70878a853] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:51:27.528330 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:27.530358 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:27.615833 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] [instance: 56a6dd87-3a3c-4997-a81a-35a70878a853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:51:27.617138 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:27.617596 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:27.858037 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:27.858037 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-4d5b822a-995d-42e2-9966-58704836f299 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:33.169171 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:51:33.235871 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:33.236293 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:33.432007 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:33.433757 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:33.434555 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:33.436101 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:33.478417 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Getting quotas for project 3f2d4e3c4d0345fa8297a7b15149d2b4. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:51:33.490730 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Getting quotas for user 5ca2f1eea94a4ca7a5418073e02c76d4 and project 3f2d4e3c4d0345fa8297a7b15149d2b4. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:51:33.527114 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] [instance: c1411eb9-e486-405c-8ac3-875947fc54c7] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:51:33.528329 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:33.528903 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:33.606719 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] [instance: c1411eb9-e486-405c-8ac3-875947fc54c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:51:33.608015 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:33.608459 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:33.915117 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:33.915745 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a4fc328d-c2cb-4c5a-95b9-1cf96026c670 tempest-InstanceActionsV221TestJSON-880878339 tempest-InstanceActionsV221TestJSON-880878339-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:58.355065 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Took 0.92 seconds to select destinations for 2 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:51:58.398704 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:58.399583 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:58.586334 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:58.587120 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:58.811805 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:58.814130 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:58.815333 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:58.820988 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:58.863388 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Getting quotas for project 1a849b548b2741a795274f569ccbb3db. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:51:58.871353 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Getting quotas for user 77307b5b46be4f77bc36beb1427557d9 and project 1a849b548b2741a795274f569ccbb3db. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:51:58.914464 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] [instance: 8d319778-1ec0-4dd1-b22d-2629762f2825] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:51:58.918219 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:58.922359 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:59.036795 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] [instance: 8d319778-1ec0-4dd1-b22d-2629762f2825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:51:59.038251 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:59.039338 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:59.288868 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:59.289671 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:59.308723 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] [instance: 48949a8c-3623-44d7-b732-9a8243ffb2e3] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:51:59.311263 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:59.313272 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:59.405045 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] [instance: 48949a8c-3623-44d7-b732-9a8243ffb2e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:51:59.408093 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:59.408946 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:51:59.824235 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:51:59.824939 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c75ec77e-09c5-4773-9cd2-f6684f4399f0 tempest-MultipleCreateTestJSON-1593474574 tempest-MultipleCreateTestJSON-1593474574-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:04.317757 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:52:04.367465 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:04.368181 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:04.511566 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:04.512399 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:04.514246 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:04.514246 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:04.540685 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:52:04.546730 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for user 5e64feaee22c4cdaafa9740a71fa4f31 and project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:52:04.561127 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: 1db9997f-0cc3-4d49-99da-7689542238f6] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:52:04.563184 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:04.563817 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:04.679778 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: 1db9997f-0cc3-4d49-99da-7689542238f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:52:04.681406 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:04.681823 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:04.970992 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:04.971406 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3d58dfd7-0e98-4233-944f-45e887d03020 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:14.536230 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:52:14.579565 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:14.580755 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:14.823907 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:14.824355 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:14.825147 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:14.825628 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:14.852183 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Getting quotas for project 233d1bc03b1844dfa143141bfdd91689. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:52:14.856920 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Getting quotas for user 83d345f1777e4acba8a671a8240fdb5a and project 233d1bc03b1844dfa143141bfdd91689. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:52:14.871590 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] [instance: d261c623-5987-434b-b506-a4bea18d1391] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:52:14.871590 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:14.871590 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:14.949764 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] [instance: d261c623-5987-434b-b506-a4bea18d1391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:52:14.951239 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:14.951662 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:15.220582 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:15.221023 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e5e92fde-1042-4726-b65e-982179347c47 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:21.418650 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:52:22.452454 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51634. Jun 10 02:52:41.635651 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 02:52:42.661136 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 52122. Jun 10 02:52:47.512448 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:52:47.540356 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:47.540953 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:47.779835 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:47.780554 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:47.781595 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:47.783143 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:47.804510 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Getting quotas for project b48573eab3c44a828f9d4e01dc857a6a. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:52:47.809193 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Getting quotas for user db0abf0370854bc799243011ebd9dfda and project b48573eab3c44a828f9d4e01dc857a6a. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:52:47.827335 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] [instance: de3ec3d2-c0b4-42f0-8000-9951d33a531f] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:52:47.828525 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:47.829037 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:47.885488 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] [instance: de3ec3d2-c0b4-42f0-8000-9951d33a531f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:52:47.887057 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:47.887568 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:48.155465 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:48.155940 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-59b84265-ff4c-4aec-bc6e-bcf878218133 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:48.976239 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:48.983187 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:49.575018 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:52:49.607660 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:49.607987 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:49.885270 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:49.885989 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:49.887002 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:49.887463 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:49.907124 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Getting quotas for project 8be61201f7c146b98bdfb7d2cee980ac. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:52:49.912113 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Getting quotas for user a63a8cd091464864a455d775ed64d142 and project 8be61201f7c146b98bdfb7d2cee980ac. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:52:49.925251 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] [instance: 1f2cabe0-e65e-4eba-936b-bf79626ca209] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:52:49.926596 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:49.927235 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:50.008807 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] [instance: 1f2cabe0-e65e-4eba-936b-bf79626ca209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:52:50.010077 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:50.010493 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:50.314345 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:50.314986 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-a20f51df-ea89-4a10-9e6e-ade002e376d6 tempest-ServerGroupTestJSON-24467173 tempest-ServerGroupTestJSON-24467173-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:57.049079 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:52:57.073302 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:57.073803 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:57.248343 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:57.248779 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:57.249493 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:57.249882 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:57.265620 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Getting quotas for project fe98021dd1724c1484a0b72f2dda3890. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:52:57.271060 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Getting quotas for user dc575e1afb3641b39194547919edc737 and project fe98021dd1724c1484a0b72f2dda3890. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:52:57.282340 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] [instance: 726e889a-f608-4cf5-b559-d5d885a45220] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:52:57.283677 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:57.284220 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:57.344978 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] [instance: 726e889a-f608-4cf5-b559-d5d885a45220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:52:57.346411 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:57.346886 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:52:57.574160 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:52:57.574572 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dc1c5eb0-e45f-4895-b039-8d73f62c7366 tempest-VolumesBackupsTest-969449146 tempest-VolumesBackupsTest-969449146-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:13.296091 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:53:13.343773 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:13.346586 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:13.508533 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:13.511104 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:13.512223 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:13.515462 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:13.554869 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:53:13.565686 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Getting quotas for user 5e64feaee22c4cdaafa9740a71fa4f31 and project ad937db638d44f1d94e9211d9809dd20. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:53:13.585085 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: f03a8c4f-b7a1-4e94-94d2-27fc191fc3f3] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:53:13.586049 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:13.586456 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:13.655116 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] [instance: f03a8c4f-b7a1-4e94-94d2-27fc191fc3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:53:13.657533 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:13.658396 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:13.947221 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:13.947631 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-757aca39-d44c-4113-96bd-202c98ead8e3 tempest-DeleteServersTestJSON-372726111 tempest-DeleteServersTestJSON-372726111-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:23.358625 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:53:23.386676 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:23.386676 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:23.641023 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:23.641432 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:23.642162 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:23.642640 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:23.661304 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Getting quotas for project ab6414f790a3439d9ea1cc9db3cf0ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:53:23.690601 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Getting quotas for user 0140e800708a47b0bcafddd9ef7cb68b and project ab6414f790a3439d9ea1cc9db3cf0ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:53:23.708050 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] [instance: 589fc6c4-53a1-415b-ac1c-683175b2b306] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:53:23.709022 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:23.709619 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:23.835629 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] [instance: 589fc6c4-53a1-415b-ac1c-683175b2b306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:53:23.837808 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:23.837808 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.112793 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.113210 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-dd8ec6a1-1cb3-4c40-ba01-e94c6dcf1cc2 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.138672 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:53:24.171848 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.172362 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.322174 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:53:24.351881 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.352423 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.448260 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.453637 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.453637 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.453637 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.466204 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Getting quotas for project 95e264fb43204be1a1546c16ae71b4e8. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:53:24.471126 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Getting quotas for user 00d70afffb41457e99376f49ec9eac2e and project 95e264fb43204be1a1546c16ae71b4e8. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:53:24.487062 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] [instance: 80d2ae6d-b34e-412b-a1d7-f2f9c654f6db] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:53:24.488123 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.488586 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.517005 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.517579 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.518676 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.518676 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.534632 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Getting quotas for project ab6414f790a3439d9ea1cc9db3cf0ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:53:24.539246 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Getting quotas for user 0140e800708a47b0bcafddd9ef7cb68b and project ab6414f790a3439d9ea1cc9db3cf0ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:53:24.570503 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] [instance: dca4f209-f843-46c7-9ca2-09162a4dd096] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:53:24.571769 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.572392 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.596019 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] [instance: 80d2ae6d-b34e-412b-a1d7-f2f9c654f6db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:53:24.608525 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.608525 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.676492 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] [instance: dca4f209-f843-46c7-9ca2-09162a4dd096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:53:24.677803 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.678217 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:24.906551 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:24.907117 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-689a8584-10a4-4b8c-b370-59971b0a81d2 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:25.038045 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:25.038695 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-1235937c-a3b6-454d-8c6d-d926eeee3aac tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:34.518017 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-18a3d50c-3044-4a80-8aa6-8a6e60e6bd41 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method rebuild_instance {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:53:34.518545 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18a3d50c-3044-4a80-8aa6-8a6e60e6bd41 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:34.519052 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18a3d50c-3044-4a80-8aa6-8a6e60e6bd41 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:34.644880 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-18a3d50c-3044-4a80-8aa6-8a6e60e6bd41 tempest-ServerShowV247Test-923129970 tempest-ServerShowV247Test-923129970-project] [instance: dca4f209-f843-46c7-9ca2-09162a4dd096] No migration record for the rebuild/evacuate request. {{(pid=99294) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jun 10 02:53:47.222013 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:53:47.281198 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:47.281928 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:47.446787 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:47.447839 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:47.456178 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:47.456178 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:47.474132 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Getting quotas for project 95e264fb43204be1a1546c16ae71b4e8. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:53:47.499782 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Getting quotas for user 00d70afffb41457e99376f49ec9eac2e and project 95e264fb43204be1a1546c16ae71b4e8. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:53:47.527622 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] [instance: e013d520-569a-43f8-b9d2-e89d48804d43] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:53:47.528879 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:47.529437 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:47.631226 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] [instance: e013d520-569a-43f8-b9d2-e89d48804d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:53:47.632772 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:47.633328 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:53:47.905675 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:53:47.908571 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ea53a2f8-797e-454a-94e5-5d1dd768cf6d tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:03.067568 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:54:03.097204 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:03.097622 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:03.339487 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:03.347483 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:03.349279 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:03.349868 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:03.373479 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Getting quotas for project 0590c907b8db4171b930839ddbd80621. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:54:03.379739 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Getting quotas for user 66d6575ea9bc41a99b6ca4fda72fad51 and project 0590c907b8db4171b930839ddbd80621. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:54:03.407567 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] [instance: 777bbb0c-ffe7-45ae-88ec-f1b19d12c2c6] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:54:03.409649 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:03.410466 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:03.479805 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] [instance: 777bbb0c-ffe7-45ae-88ec-f1b19d12c2c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:54:03.483159 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:03.483159 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:03.823425 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:03.824130 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9f0ff623-7df2-495e-80dc-3b5a07d943fe tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:06.702278 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:54:06.728389 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:06.728869 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:07.011519 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:07.011935 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:07.012663 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:07.013060 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:07.034771 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Getting quotas for project 0db13a78e4e84f55ac42e02347ece3c2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:54:07.042096 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Getting quotas for user 92e7aff178e44527b69907d79d289072 and project 0db13a78e4e84f55ac42e02347ece3c2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:54:07.054165 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] [instance: 86b2d4bd-cb4f-4655-826d-bc2f585b96b4] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:54:07.055385 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:07.056484 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:07.141888 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] [instance: 86b2d4bd-cb4f-4655-826d-bc2f585b96b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:54:07.143162 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:07.143569 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:07.459205 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:07.459614 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-e2c13281-422c-478a-8d46-94f0c31455bd tempest-InstanceActionsNegativeTestJSON-133708359 tempest-InstanceActionsNegativeTestJSON-133708359-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:18.539306 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:54:18.568667 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:18.569305 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:18.837225 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:18.838078 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:18.845464 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:18.846137 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:18.864841 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Getting quotas for project ad520f54c59640b1af54ce21b9510605. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:54:18.872222 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Getting quotas for user a31b2efa25e144898c060456fdb25f6d and project ad520f54c59640b1af54ce21b9510605. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:54:18.883893 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] [instance: 321c9f33-1a1c-491b-bb12-913b50e54880] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:54:18.885219 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:18.885847 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:19.026846 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] [instance: 321c9f33-1a1c-491b-bb12-913b50e54880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:54:19.028761 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:19.028761 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:19.172551 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-5980b0e2-5c26-4ef6-bf9b-59c69451c844 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method rebuild_instance {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:54:19.175178 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-5980b0e2-5c26-4ef6-bf9b-59c69451c844 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:19.175647 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-5980b0e2-5c26-4ef6-bf9b-59c69451c844 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:19.301885 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-5980b0e2-5c26-4ef6-bf9b-59c69451c844 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] [instance: 777bbb0c-ffe7-45ae-88ec-f1b19d12c2c6] No migration record for the rebuild/evacuate request. {{(pid=99293) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jun 10 02:54:19.306583 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5980b0e2-5c26-4ef6-bf9b-59c69451c844 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] [c252951e-465d-41f2-8a84-d6a9fc65bece] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 02:54:19.321793 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:19.322547 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-58acbd4d-976f-496b-a97b-5ce719d624db tempest-ServersNegativeTestMultiTenantJSON-1833548815 tempest-ServersNegativeTestMultiTenantJSON-1833548815-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:20.322873 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [None req-5980b0e2-5c26-4ef6-bf9b-59c69451c844 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] [c252951e-465d-41f2-8a84-d6a9fc65bece] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 54074. Jun 10 02:54:38.991068 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Took 1.10 seconds to select destinations for 3 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:54:39.031246 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:39.031739 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:39.238234 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:39.238977 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:39.381312 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:39.381725 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:39.597317 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:39.597723 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:39.598607 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:39.599028 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:39.638178 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Getting quotas for project 5d0ff0504a7641fd935aa570f14c0311. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:54:39.649786 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Getting quotas for user bf6b6ede604e40fabf82797e7aee2327 and project 5d0ff0504a7641fd935aa570f14c0311. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:54:39.661854 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] [instance: e9f97883-00da-4dc4-8ef3-ac904ba7ccea] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:54:39.662921 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:39.663514 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:39.737082 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] [instance: e9f97883-00da-4dc4-8ef3-ac904ba7ccea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:54:39.738569 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:39.743164 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:40.011868 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:40.012446 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:40.040264 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] [instance: a2168d84-f57f-46c3-9d64-17d5e2bab121] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:54:40.041581 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:40.042150 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:40.283221 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] [instance: a2168d84-f57f-46c3-9d64-17d5e2bab121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:54:40.284616 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:40.287001 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:40.663721 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:40.664653 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:40.688285 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] [instance: 13bdf142-d159-4299-b28a-f9867db88cf7] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:54:40.693812 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:40.693812 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:40.791348 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] [instance: 13bdf142-d159-4299-b28a-f9867db88cf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:54:40.793307 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:40.795251 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:54:41.108799 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:54:41.110066 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cae9386d-847f-4633-ab3b-0eb32ea7cb22 tempest-ListServersNegativeTestJSON-1202091124 tempest-ListServersNegativeTestJSON-1202091124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:03.282409 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:55:03.309146 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:03.309871 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:03.468413 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:03.469076 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:03.470428 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:03.472128 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:03.500786 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Getting quotas for project 0590c907b8db4171b930839ddbd80621. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:55:03.507418 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Getting quotas for user 66d6575ea9bc41a99b6ca4fda72fad51 and project 0590c907b8db4171b930839ddbd80621. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:55:03.525447 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] [instance: 4c144a59-26bb-4404-9e57-2d8eca912fda] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:55:03.526905 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:03.528334 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:03.665136 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] [instance: 4c144a59-26bb-4404-9e57-2d8eca912fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:55:03.666424 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:03.666832 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:04.076720 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:04.077367 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-987b71af-b272-47f5-9cff-0b4da7610035 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:22.452276 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 02:55:23.486860 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 56516. Jun 10 02:55:42.659038 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 02:55:43.703338 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 56930. Jun 10 02:55:52.157186 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-42aa8750-e61e-4fea-9f22-5afd5152be2a tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method rebuild_instance {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:55:52.168249 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-42aa8750-e61e-4fea-9f22-5afd5152be2a tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:52.171949 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-42aa8750-e61e-4fea-9f22-5afd5152be2a tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:52.589798 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-42aa8750-e61e-4fea-9f22-5afd5152be2a tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] [instance: 4c144a59-26bb-4404-9e57-2d8eca912fda] No migration record for the rebuild/evacuate request. {{(pid=99293) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jun 10 02:55:52.931430 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:55:52.955099 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:52.955511 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:53.308743 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:53.313725 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:53.314722 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:53.315438 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:53.349818 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Getting quotas for project 6729d4a5d474425fbaf7510df61e2ca1. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:55:53.356301 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Getting quotas for user 44aa4dffca6b4a8cb4eab92d4e3d19db and project 6729d4a5d474425fbaf7510df61e2ca1. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:55:53.375547 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] [instance: f4d22d10-ac17-4c0b-a6a1-c0c0768387ed] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:55:53.377996 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:53.379602 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:53.445629 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] [instance: f4d22d10-ac17-4c0b-a6a1-c0c0768387ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:55:53.447882 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:53.448664 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:55:53.788916 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:55:53.789814 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-eb0bdeb1-7a8c-414c-a7c3-ea521f7c175a tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:56:01.430036 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-f5273834-6087-447c-9071-55c0b04868f7 tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method rebuild_instance {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:56:01.433133 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f5273834-6087-447c-9071-55c0b04868f7 tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:56:01.435485 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f5273834-6087-447c-9071-55c0b04868f7 tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:56:01.643999 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-f5273834-6087-447c-9071-55c0b04868f7 tempest-ServerShowV257Test-1527227267 tempest-ServerShowV257Test-1527227267-project] [instance: f4d22d10-ac17-4c0b-a6a1-c0c0768387ed] No migration record for the rebuild/evacuate request. {{(pid=99294) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jun 10 02:56:03.103521 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9dca4850-88da-479f-8885-b966a5d35244 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method unshelve_instance {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 02:56:03.104068 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9dca4850-88da-479f-8885-b966a5d35244 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:56:03.104450 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-9dca4850-88da-479f-8885-b966a5d35244 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:56:04.763874 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9dca4850-88da-479f-8885-b966a5d35244 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] [instance: 80d2ae6d-b34e-412b-a1d7-f2f9c654f6db] Requesting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) during scheduling {{(pid=99293) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Jun 10 02:56:05.489829 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-9dca4850-88da-479f-8885-b966a5d35244 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:56:05.513123 n-d-779913-11 nova-conductor[99293]: DEBUG nova.objects.instance [None req-9dca4850-88da-479f-8885-b966a5d35244 tempest-ServersNegativeTestJSON-124088943 tempest-ServersNegativeTestJSON-124088943-project] Lazy-loading 'flavor' on Instance uuid 80d2ae6d-b34e-412b-a1d7-f2f9c654f6db {{(pid=99293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 02:56:22.460275 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:56:22.509289 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:56:22.510384 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:56:22.708745 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:56:22.713584 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:56:22.715000 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:56:22.716348 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:56:22.791500 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Getting quotas for project 0590c907b8db4171b930839ddbd80621. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:56:22.828385 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Getting quotas for user 66d6575ea9bc41a99b6ca4fda72fad51 and project 0590c907b8db4171b930839ddbd80621. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:56:22.902434 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] [instance: 39fc3d48-05c5-4fd8-a563-c14de04095f3] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:56:22.903523 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:56:22.905969 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:56:22.986910 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] [instance: 39fc3d48-05c5-4fd8-a563-c14de04095f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:56:22.988521 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:56:22.988942 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:56:23.300089 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:56:23.300089 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2a084366-e1e6-43f2-83af-5db2837f8b87 tempest-ServerDiskConfigTestJSON-42300945 tempest-ServerDiskConfigTestJSON-42300945-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:32.819280 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Took 1.26 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:57:32.901491 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:32.901893 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:33.449180 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:33.449895 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:33.450813 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:33.452070 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:33.522112 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Getting quotas for project 05923011edd3471c8867071df78f595b. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:57:33.532814 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Getting quotas for user 338ff864866347a5b2758e176670164f and project 05923011edd3471c8867071df78f595b. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:57:33.559981 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] [instance: 0f14c8e7-b9fe-4455-9b54-1aa8ac806eca] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:57:33.562255 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:33.569797 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:33.686375 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] [instance: 0f14c8e7-b9fe-4455-9b54-1aa8ac806eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:57:33.690970 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:33.690970 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:34.133753 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:34.134806 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-bb4880ae-58fc-4c48-ac7f-773e2dcfb82c tempest-ServerRescueTestJSONUnderV235-1914773966 tempest-ServerRescueTestJSONUnderV235-1914773966-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:34.797835 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:57:34.860312 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:34.864299 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:35.114450 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:35.119537 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:35.121241 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:35.123298 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:35.187514 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Getting quotas for project b48573eab3c44a828f9d4e01dc857a6a. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:57:35.206541 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Getting quotas for user db0abf0370854bc799243011ebd9dfda and project b48573eab3c44a828f9d4e01dc857a6a. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:57:35.247071 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] [instance: c24629b6-2786-4fd1-b61f-e538fd3565cd] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:57:35.248970 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:35.249582 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:35.356884 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] [instance: c24629b6-2786-4fd1-b61f-e538fd3565cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:57:35.358983 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:35.362173 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:57:35.693831 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:57:35.694232 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-24be533a-17a8-4912-8559-fb0389fedd60 tempest-AttachVolumeTestJSON-313632165 tempest-AttachVolumeTestJSON-313632165-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:05.409831 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Took 1.10 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:58:05.519689 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:05.520091 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:05.726470 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:05.726823 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:05.729436 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:05.729854 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:05.817561 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Getting quotas for project 233d1bc03b1844dfa143141bfdd91689. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:58:05.828699 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Getting quotas for user 83d345f1777e4acba8a671a8240fdb5a and project 233d1bc03b1844dfa143141bfdd91689. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:58:05.866478 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] [instance: b4d6b362-5ef3-479b-9f6f-944593179fe8] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:58:05.868996 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:05.872173 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:05.941382 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] [instance: b4d6b362-5ef3-479b-9f6f-944593179fe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:58:05.943585 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:05.944015 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:06.330371 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:06.331050 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53135a31-2dd1-468b-bbb9-26ef278826e1 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:23.487503 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 02:58:24.512088 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 33486. Jun 10 02:58:34.708395 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 02:58:43.716376 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 02:58:44.734572 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 34036. Jun 10 02:58:58.522394 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 02:58:58.597025 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:58.599523 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:58.941354 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:58.941354 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:58.941354 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:58.941354 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:58.988605 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Getting quotas for project 233d1bc03b1844dfa143141bfdd91689. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 02:58:59.010189 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Getting quotas for user 83d345f1777e4acba8a671a8240fdb5a and project 233d1bc03b1844dfa143141bfdd91689. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 02:58:59.049693 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] [instance: 2da12ac5-4281-410e-bd08-0bbeb5905792] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 02:58:59.050659 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:59.051263 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:59.155757 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] [instance: 2da12ac5-4281-410e-bd08-0bbeb5905792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 02:58:59.157677 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:59.160201 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 02:58:59.518376 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 02:58:59.519109 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-09a3d732-66ba-4c91-9335-d14821769441 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:00:14.883898 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:00:15.907211 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36978. Jun 10 03:00:34.934543 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:00:36.767625 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:00:37.803700 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37622. Jun 10 03:00:38.835580 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:01:07.462366 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:01:21.055560 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:01:22.077925 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38558. Jun 10 03:01:24.513397 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:01:25.588053 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38644. Jun 10 03:01:30.615989 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:01:30.654569 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:01:30.654873 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:01:31.318651 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:01:31.319336 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:01:31.325197 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:01:31.325197 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:01:31.379085 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Getting quotas for project 16370f278c2b4760b9d736a181f235f7. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:01:31.386314 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Getting quotas for user 2f9a0994c6f14a969f7941d535150c62 and project 16370f278c2b4760b9d736a181f235f7. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:01:31.442608 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] [instance: 180a8526-cd76-4eea-a751-737af54274af] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:01:31.446212 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:01:31.447220 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:01:31.526501 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] [instance: 180a8526-cd76-4eea-a751-737af54274af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:01:31.529141 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:01:31.529656 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:01:31.914135 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:01:31.916240 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62e1660b-f601-4b8d-812a-9536c695d6d7 tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:01:44.735257 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:01:45.763480 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39134. Jun 10 03:01:54.728240 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:02:12.309269 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:02:12.344871 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:12.346039 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:12.478641 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:12.479335 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:12.485353 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:12.486171 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:12.530132 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Getting quotas for project 233d1bc03b1844dfa143141bfdd91689. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:02:12.537627 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Getting quotas for user 83d345f1777e4acba8a671a8240fdb5a and project 233d1bc03b1844dfa143141bfdd91689. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:02:12.550702 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] [instance: 1229793d-0a04-4be2-a027-dc3363bce56b] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:02:12.552414 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:12.553041 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:12.702330 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] [instance: 1229793d-0a04-4be2-a027-dc3363bce56b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:02:12.702330 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:12.702989 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:12.975468 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:12.976087 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f305c929-26a6-4d0b-bc5d-c3eb0ab5dddc tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:17.506165 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:02:17.564625 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:17.565047 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:17.751690 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:17.752437 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:17.753425 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:17.754138 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:17.815592 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Getting quotas for project 16370f278c2b4760b9d736a181f235f7. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:02:17.833136 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Getting quotas for user 2f9a0994c6f14a969f7941d535150c62 and project 16370f278c2b4760b9d736a181f235f7. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:02:17.893495 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] [instance: 34c393b3-3191-4705-bc60-d77b9a89bc7c] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:02:17.896095 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:17.896501 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:17.975496 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] [instance: 34c393b3-3191-4705-bc60-d77b9a89bc7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:02:17.978456 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:17.978765 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:18.232797 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:18.233458 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-18500b20-0a16-4c72-a884-33b789a93fec tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:47.282599 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:02:47.332939 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:47.333513 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:47.737308 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:47.743358 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:47.765412 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:47.765907 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:47.857850 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Getting quotas for project 075122715cfb4248a5316bc58a21dc5d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:02:47.875745 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Getting quotas for user d4b5d7642a4f48aea321d139fce33689 and project 075122715cfb4248a5316bc58a21dc5d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:02:47.922651 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] [instance: c5b776ce-f5ac-4418-910d-5f13c116f07c] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:02:47.925004 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:47.925643 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:48.000982 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] [instance: c5b776ce-f5ac-4418-910d-5f13c116f07c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:02:48.002798 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:48.003513 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:48.393037 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:48.393993 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-d55014e6-54b8-4c09-a820-fd96f18d37a7 tempest-VolumesActionsTest-1361534864 tempest-VolumesActionsTest-1361534864-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:52.547465 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:02:52.609031 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:52.609403 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:52.877936 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:52.878723 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:52.881953 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:52.882700 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:52.958221 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Getting quotas for project 233d1bc03b1844dfa143141bfdd91689. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:02:52.983735 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Getting quotas for user 83d345f1777e4acba8a671a8240fdb5a and project 233d1bc03b1844dfa143141bfdd91689. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:02:53.047570 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] [instance: fe93b522-b17f-4ce6-9ad1-9517583b0466] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:02:53.051144 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:53.053897 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:53.131353 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] [instance: fe93b522-b17f-4ce6-9ad1-9517583b0466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:02:53.133378 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:53.133925 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:02:53.565682 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:02:53.566365 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-593c36cb-565d-457d-8f7e-2ef1b4ee2b08 tempest-ServerActionsTestJSON-618051831 tempest-ServerActionsTestJSON-618051831-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:03:03.401715 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:03:03.448200 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:03:03.448671 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:03:03.771970 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:03:03.772327 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:03:03.773393 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:03:03.779240 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:03:03.802488 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Getting quotas for project 16370f278c2b4760b9d736a181f235f7. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:03:03.814306 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Getting quotas for user 2f9a0994c6f14a969f7941d535150c62 and project 16370f278c2b4760b9d736a181f235f7. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:03:03.850843 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] [instance: 0eaecc9e-7cd2-4b08-8300-64920a1daf72] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:03:03.853996 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:03:03.854645 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:03:03.990319 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] [instance: 0eaecc9e-7cd2-4b08-8300-64920a1daf72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:03:03.991622 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:03:03.992033 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:03:04.389046 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:03:04.389422 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-fa29bf25-b23d-4693-a84e-6519ff189f9b tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:15.190664 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:04:15.243236 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:15.257264 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:15.511151 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:15.516337 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:15.518977 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:15.520955 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:15.574959 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Getting quotas for project 16370f278c2b4760b9d736a181f235f7. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:04:15.584073 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Getting quotas for user 2f9a0994c6f14a969f7941d535150c62 and project 16370f278c2b4760b9d736a181f235f7. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:04:15.614879 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] [instance: 8164937a-abcc-47e3-bc75-1711b5c3d380] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:04:15.615925 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:15.616329 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:15.803327 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] [instance: 8164937a-abcc-47e3-bc75-1711b5c3d380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:04:15.803327 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:15.803327 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:16.145704 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:16.146122 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3a1bcab9-c50a-417a-b825-304b1716996a tempest-AttachVolumeNegativeTest-550907631 tempest-AttachVolumeNegativeTest-550907631-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:25.531543 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:04:26.552517 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43194. Jun 10 03:04:27.507654 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:04:44.819647 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:04:44.846805 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:44.847673 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:45.254373 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:45.257646 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:45.258577 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:45.259064 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:45.307932 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Getting quotas for project 2e347fe106b3449fb9b5879c2692b37b. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:04:45.322888 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Getting quotas for user 9a6bf29a95294fdeb71999f20eeb5d97 and project 2e347fe106b3449fb9b5879c2692b37b. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:04:45.348015 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] [instance: 628f9c6d-3632-46e7-9c48-1476e119814f] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:04:45.354259 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:45.361125 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:45.447863 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] [instance: 628f9c6d-3632-46e7-9c48-1476e119814f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:04:45.449116 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:45.450340 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:45.755842 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:04:45.784458 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:04:45.784458 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-4239d2ff-1423-4bde-94bb-7027f86d6fef tempest-VolumesNegativeTest-78632161 tempest-VolumesNegativeTest-78632161-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:04:46.794209 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43794. Jun 10 03:05:14.757612 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:06:05.349059 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Took 1.06 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:06:05.450935 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:05.461904 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:05.726467 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:05.726916 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:05.727674 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:05.728103 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:05.771872 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Getting quotas for project 8b3c5b8caf2c426c82e3d0468ded41a0. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:06:05.785834 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Getting quotas for user bfaed094a3364056ad5661c89e6b5d9b and project 8b3c5b8caf2c426c82e3d0468ded41a0. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:06:05.816315 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] [instance: 29ac7c75-d8e8-4471-8b89-ea9339a4df55] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:06:05.817842 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:05.819278 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:06.059850 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] [instance: 29ac7c75-d8e8-4471-8b89-ea9339a4df55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:06:06.059850 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:06.059850 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:06.540479 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:06.544796 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8227cf10-599e-4e86-bb43-68fb986a57cc tempest-ServerAddressesNegativeTestJSON-1747455630 tempest-ServerAddressesNegativeTestJSON-1747455630-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:12.227878 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:06:12.262171 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:12.262832 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:12.499973 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:12.500652 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:12.501560 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:12.502193 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:12.518531 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Getting quotas for project 3c3bae0fd7f6412e8f7340b651982bcf. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:06:12.523830 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Getting quotas for user 3a7e001cca11460ab096bd76cc7da816 and project 3c3bae0fd7f6412e8f7340b651982bcf. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:06:12.534730 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] [instance: 992e9171-bdb2-47a7-ac83-f2fde99eab81] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:06:12.536827 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:12.538259 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:12.728628 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] [instance: 992e9171-bdb2-47a7-ac83-f2fde99eab81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:06:12.730890 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:12.731652 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:13.029598 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:13.030075 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-75a68446-3515-4cb7-bb78-1084a94fc65d tempest-TestServerAdvancedOps-1961919081 tempest-TestServerAdvancedOps-1961919081-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:51.824292 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:06:51.855526 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:51.855905 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:52.083652 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:52.084055 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:52.084771 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:52.085149 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:52.114890 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Getting quotas for project 0ff6090adb1a49c8aa64ff18035298e6. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:06:52.121377 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Getting quotas for user 6501423ae9fe43369179f3aed9996995 and project 0ff6090adb1a49c8aa64ff18035298e6. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:06:52.134632 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] [instance: c71a698a-c04d-4523-8d9e-77976b0f3945] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:06:52.135826 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:52.136423 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:52.246506 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] [instance: c71a698a-c04d-4523-8d9e-77976b0f3945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:06:52.248554 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:52.249247 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:06:52.687985 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:06:52.687985 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-cf3e7f84-db02-42fd-91e7-a52a57684b12 tempest-ServerPasswordTestJSON-1913248957 tempest-ServerPasswordTestJSON-1913248957-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:07:26.554505 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:07:27.580636 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 47964. Jun 10 03:07:46.796335 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:07:47.533032 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:07:47.853910 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48374. Jun 10 03:08:02.632036 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:08:02.683642 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:08:02.684018 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:08:03.033703 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:08:03.035572 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:08:03.038780 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:08:03.043088 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:08:03.109873 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Getting quotas for project edbbcbe8f4a3463bbe58f3f80f25e103. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:08:03.117902 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Getting quotas for user b7ee3f4715f84f82b9d27851f267bf19 and project edbbcbe8f4a3463bbe58f3f80f25e103. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:08:03.136180 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] [instance: 49e0ad7a-4567-4801-ab83-90d2a00e1a37] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:08:03.138398 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:08:03.139041 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:08:03.231261 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] [instance: 49e0ad7a-4567-4801-ab83-90d2a00e1a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:08:03.232702 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:08:03.233698 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:08:03.560962 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:08:03.561377 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-02c542ce-cdc7-4624-9056-e885a9bdf077 tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:08:34.784489 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:09:05.105612 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:09:05.141758 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:09:05.142907 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:09:05.386160 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:09:05.388482 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:09:05.391128 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:09:05.391889 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:09:05.433291 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Getting quotas for project edbbcbe8f4a3463bbe58f3f80f25e103. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:09:05.440011 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Getting quotas for user b7ee3f4715f84f82b9d27851f267bf19 and project edbbcbe8f4a3463bbe58f3f80f25e103. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:09:05.459426 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] [instance: 82e80a88-a86d-4dc8-acd7-a20487075d9e] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:09:05.462180 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:09:05.463180 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:09:05.592580 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] [instance: 82e80a88-a86d-4dc8-acd7-a20487075d9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:09:05.593841 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:09:05.594250 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:09:06.067446 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:09:06.069519 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e77c71ec-cb4f-4bbd-940f-88d6a860989e tempest-ServerRescueTestJSON-656623922 tempest-ServerRescueTestJSON-656623922-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:10:15.911462 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:10:16.970541 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51496. Jun 10 03:10:27.578117 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:10:28.608808 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51840. Jun 10 03:10:34.985063 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:10:37.802836 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:10:38.828361 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 52158. Jun 10 03:10:38.865864 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:10:43.907710 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Took 1.41 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:10:43.975054 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:10:43.977148 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:10:44.227705 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:10:44.227705 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:10:44.228161 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:10:44.229263 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:10:44.278539 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Getting quotas for project 1453f3064b074c00b280ca52f9224fab. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:10:44.291927 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Getting quotas for user bf116b6da467468482db6aebf17a3fad and project 1453f3064b074c00b280ca52f9224fab. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:10:44.326633 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] [instance: cdf0872e-f004-415b-9b60-e1e3c36ac843] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:10:44.327770 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:10:44.328193 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:10:44.478891 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] [instance: cdf0872e-f004-415b-9b60-e1e3c36ac843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:10:44.481555 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:10:44.481555 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:10:44.863875 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:10:44.863875 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c2856df9-46fe-43b4-87ec-45e6ee27fd6d tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:10:47.841088 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:10:48.869081 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 52536. Jun 10 03:10:53.898539 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7cfa5781-11d2-4350-9a11-6df6db4e6e58 tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method rebuild_instance {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:10:53.901130 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cfa5781-11d2-4350-9a11-6df6db4e6e58 tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:10:53.904656 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cfa5781-11d2-4350-9a11-6df6db4e6e58 tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:10:54.040661 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7cfa5781-11d2-4350-9a11-6df6db4e6e58 tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] [instance: cdf0872e-f004-415b-9b60-e1e3c36ac843] No migration record for the rebuild/evacuate request. {{(pid=99293) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jun 10 03:10:54.046528 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7cfa5781-11d2-4350-9a11-6df6db4e6e58 tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] [c252951e-465d-41f2-8a84-d6a9fc65bece] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 03:10:55.068434 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [None req-7cfa5781-11d2-4350-9a11-6df6db4e6e58 tempest-ServerShowV254Test-1545677196 tempest-ServerShowV254Test-1545677196-project] [c252951e-465d-41f2-8a84-d6a9fc65bece] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 52714. Jun 10 03:11:54.814604 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:12:00.681599 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:12:00.738636 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:00.741692 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:01.088676 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:01.119096 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:01.120507 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:01.121897 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:01.181110 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Getting quotas for project d4e8084bdffd40b38c70dae5ea9a68c2. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:12:01.202169 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Getting quotas for user 7f354b7b61ee44cca2abe1c0c91360ee and project d4e8084bdffd40b38c70dae5ea9a68c2. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:12:01.242402 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] [instance: 0493858c-7e98-4fd6-8d43-ccdb0e866166] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:12:01.249818 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:01.250560 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:01.405466 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] [instance: 0493858c-7e98-4fd6-8d43-ccdb0e866166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:12:01.406751 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:01.407470 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:01.628404 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:01.629318 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c712d89b-b1ee-4c8a-8f0a-d5f58af43854 tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:09.878156 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Took 1.06 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:12:09.949801 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:09.949961 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:10.325392 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:10.335758 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:10.336657 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:10.337148 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:10.388853 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Getting quotas for project 1526889e74c14ff8a61c66e28611defb. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:12:10.402534 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Getting quotas for user 3f4a1b176e214c4d8999f0ae0a2f3fbd and project 1526889e74c14ff8a61c66e28611defb. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:12:10.425784 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] [instance: 499c8bdc-edad-4cda-b793-8ee4cf8f8f47] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:12:10.427621 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:10.428257 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:10.500714 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] [instance: 499c8bdc-edad-4cda-b793-8ee4cf8f8f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:12:10.502488 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:10.502890 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:10.811157 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:10.811684 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-53ffcb0a-e921-4302-baee-e5b410473ee5 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:34.530452 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:12:34.566292 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:34.566966 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:34.798790 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:34.799964 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:34.803234 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:34.809061 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:34.868017 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Getting quotas for project 0e96f46bc84f4c6dbf2c27f13b6999af. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:12:34.886917 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Getting quotas for user c129a3b5419441f78f16de5f02ad4850 and project 0e96f46bc84f4c6dbf2c27f13b6999af. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:12:34.914909 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] [instance: 3a5c0d7c-2187-4072-929c-76e1a332ad7d] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:12:34.918293 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:34.919360 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:35.005777 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] [instance: 3a5c0d7c-2187-4072-929c-76e1a332ad7d] block_device_mapping [BlockDeviceMapping(attachment_id=5f3dd774-2dcd-49e4-a906-a4ef12689ec2,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f4b61a7-232a-49fc-8f66-78d4103de952',volume_size=1,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:12:35.007991 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:35.008640 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:12:35.325282 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:12:35.325967 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-fa4490fa-8793-4651-a8d7-cb3bc4ef61ca tempest-TestVolumeBackupRestore-1338135253 tempest-TestVolumeBackupRestore-1338135253-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:13:06.325356 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:13:06.350408 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:13:06.350886 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:13:06.596411 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:13:06.598592 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:13:06.605667 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:13:06.605667 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:13:06.652478 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Getting quotas for project e5beaf0af16b492ea160c51969a3504d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:13:06.658933 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Getting quotas for user 7590c8cc923f4a598f6c6cf866d300a7 and project e5beaf0af16b492ea160c51969a3504d. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:13:06.674312 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] [instance: 963ebfea-2172-4a5b-abe7-60b77dbc2846] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:13:06.675695 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:13:06.676314 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:13:06.768845 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] [instance: 963ebfea-2172-4a5b-abe7-60b77dbc2846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:13:06.770101 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:13:06.770500 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:13:07.022429 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:13:07.022672 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b967af0d-79c8-4fc9-9766-30dbd162a48d tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:13:28.608641 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:13:29.627841 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 56878. Jun 10 03:13:48.865693 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:13:49.885599 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 57120. Jun 10 03:14:08.883574 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:14:08.912612 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:08.912612 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:09.081056 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:09.081814 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:09.083342 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:09.083898 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:09.111822 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Getting quotas for project d4e8084bdffd40b38c70dae5ea9a68c2. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:14:09.118285 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Getting quotas for user 7f354b7b61ee44cca2abe1c0c91360ee and project d4e8084bdffd40b38c70dae5ea9a68c2. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:14:09.135652 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] [instance: 77082e26-704e-4c91-a1ba-aeaa3ef97b3e] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:14:09.137596 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:09.138007 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:09.213477 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] [instance: 77082e26-704e-4c91-a1ba-aeaa3ef97b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:14:09.216030 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:09.216558 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:09.501716 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:09.502446 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-255a9cfd-17de-4f68-864c-70296f92903e tempest-VolumesSnapshotTestJSON-1002973498 tempest-VolumesSnapshotTestJSON-1002973498-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:48.928191 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:14:48.996620 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:48.997290 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:49.411191 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:49.415949 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:49.415949 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:49.415949 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:49.475241 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Getting quotas for project b0ddf6e10bac450ca3188e5d745555d2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:14:49.482159 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Getting quotas for user 3431e087f9b14ab2aacc18d6430a7873 and project b0ddf6e10bac450ca3188e5d745555d2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:14:49.523431 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] [instance: 58ca1e86-f860-43ea-843a-a71d3a62a09b] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:14:49.528239 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:49.529542 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:49.661183 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] [instance: 58ca1e86-f860-43ea-843a-a71d3a62a09b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:14:49.662500 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:49.662894 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:50.032360 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:50.033009 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7fbafe4d-433d-4f64-a231-4a8f5b9436f3 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:57.050651 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:14:57.090531 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:57.091311 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:57.303557 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:57.304388 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:57.306667 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:57.309333 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:57.332365 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Getting quotas for project e5beaf0af16b492ea160c51969a3504d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:14:57.339556 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Getting quotas for user 7590c8cc923f4a598f6c6cf866d300a7 and project e5beaf0af16b492ea160c51969a3504d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:14:57.351077 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] [instance: 0cbbfe7a-f02b-4920-89ee-257ee961a87b] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:14:57.352305 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:57.352867 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:57.489722 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] [instance: 0cbbfe7a-f02b-4920-89ee-257ee961a87b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:14:57.491767 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:57.492398 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:14:57.779820 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:14:57.780378 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-582aa300-e0cf-4f3f-802a-d8503eec518f tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:15:14.840110 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:15:54.253275 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-527bb2ca-2529-4acc-95a3-3377a015edfb tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method unshelve_instance {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:15:54.253905 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-527bb2ca-2529-4acc-95a3-3377a015edfb tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:15:54.254169 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-527bb2ca-2529-4acc-95a3-3377a015edfb tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:15:54.968151 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-527bb2ca-2529-4acc-95a3-3377a015edfb tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] [instance: 499c8bdc-edad-4cda-b793-8ee4cf8f8f47] Requesting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) during scheduling {{(pid=99293) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Jun 10 03:15:55.541545 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-527bb2ca-2529-4acc-95a3-3377a015edfb tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:15:55.550610 n-d-779913-11 nova-conductor[99293]: DEBUG nova.objects.instance [None req-527bb2ca-2529-4acc-95a3-3377a015edfb tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lazy-loading 'flavor' on Instance uuid 499c8bdc-edad-4cda-b793-8ee4cf8f8f47 {{(pid=99293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 03:16:07.669310 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:16:23.328734 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:16:23.352974 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:23.353437 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:23.453937 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:23.454333 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:23.455087 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:23.455467 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:23.473515 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Getting quotas for project e5beaf0af16b492ea160c51969a3504d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:16:23.478480 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Getting quotas for user 7590c8cc923f4a598f6c6cf866d300a7 and project e5beaf0af16b492ea160c51969a3504d. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:16:23.493165 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] [instance: d1541f43-47fa-4903-9482-572dd60512b7] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:16:23.494148 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:23.494547 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:23.556188 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] [instance: d1541f43-47fa-4903-9482-572dd60512b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:16:23.556942 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:23.557217 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:23.789469 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:23.789875 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-10b8fede-84dc-4532-8b34-35553557720e tempest-TestNetworkBasicOps-24915220 tempest-TestNetworkBasicOps-24915220-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:27.831999 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-3c3c7620-1eea-429d-b5fd-075fd9588db7 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:16:27.833385 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3c3c7620-1eea-429d-b5fd-075fd9588db7 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:27.833965 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3c3c7620-1eea-429d-b5fd-075fd9588db7 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:28.196256 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-3c3c7620-1eea-429d-b5fd-075fd9588db7 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] [instance: 58ca1e86-f860-43ea-843a-a71d3a62a09b] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99293) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 03:16:28.817436 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-3c3c7620-1eea-429d-b5fd-075fd9588db7 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Created allocations for migration 4e5785d9-cbd5-41cd-a8b9-515340737518 on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99293) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 03:16:29.263684 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-3c3c7620-1eea-429d-b5fd-075fd9588db7 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] [instance: 58ca1e86-f860-43ea-843a-a71d3a62a09b] Calling prep_resize with selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [] {{(pid=99293) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 03:16:29.629708 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:16:30.646908 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 59532. Jun 10 03:16:49.885770 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:16:50.908589 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 59692. Jun 10 03:16:52.291591 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:16:52.363560 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:52.364594 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:52.568887 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:52.569396 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:52.570192 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:52.570766 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:52.588434 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Getting quotas for project 60b28e01665340ed9e6cf70f154d4c72. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:16:52.593848 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Getting quotas for user e3505dda287f45439c453220397461c8 and project 60b28e01665340ed9e6cf70f154d4c72. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:16:52.606068 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] [instance: 28379148-08ee-45b8-aece-c70332597ead] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:16:52.612251 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:52.613120 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:52.694437 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] [instance: 28379148-08ee-45b8-aece-c70332597ead] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:16:52.699251 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:52.699936 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:16:52.943673 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:16:52.944245 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-62028c3f-9f79-4ada-982d-8908b1f39f21 tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:21.641545 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:17:21.663406 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:21.663821 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:21.828680 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:21.829089 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:21.829815 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:21.830206 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:21.845340 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Getting quotas for project 1526889e74c14ff8a61c66e28611defb. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:17:21.849779 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Getting quotas for user 3f4a1b176e214c4d8999f0ae0a2f3fbd and project 1526889e74c14ff8a61c66e28611defb. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:17:21.860906 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] [instance: 11237c08-52e5-4f52-84bd-11f8e79eb784] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:17:21.861883 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:21.862290 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:21.961227 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] [instance: 11237c08-52e5-4f52-84bd-11f8e79eb784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:17:21.963943 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:21.963943 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:22.230209 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:22.230648 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-f53ae534-766e-4db3-994b-3bc5509d63ff tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:58.002495 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:17:58.029183 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:58.029620 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:58.159865 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:58.161842 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:58.162883 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:58.163791 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:58.183430 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Getting quotas for project b0ddf6e10bac450ca3188e5d745555d2. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:17:58.196355 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Getting quotas for user 3431e087f9b14ab2aacc18d6430a7873 and project b0ddf6e10bac450ca3188e5d745555d2. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:17:58.211028 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] [instance: 217a832b-8703-4cc5-a5d1-ca6f703066b5] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:17:58.211991 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:58.212401 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:58.287717 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] [instance: 217a832b-8703-4cc5-a5d1-ca6f703066b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:17:58.289408 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:58.290078 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:17:58.555055 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:17:58.555466 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-1cd7cc53-b01d-4ee9-884a-ad4ad5816cce tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:18:27.051506 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:18:27.103821 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:18:27.104828 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:18:27.225290 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:18:27.225751 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:18:27.226479 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:18:27.226871 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:18:27.250392 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Getting quotas for project 60b28e01665340ed9e6cf70f154d4c72. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:18:27.255527 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Getting quotas for user e3505dda287f45439c453220397461c8 and project 60b28e01665340ed9e6cf70f154d4c72. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:18:27.267829 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] [instance: 21470064-5e05-424c-a523-2e14aa624c69] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:18:27.268911 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:18:27.269375 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:18:27.342871 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] [instance: 21470064-5e05-424c-a523-2e14aa624c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:18:27.344138 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:18:27.344537 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:18:27.587535 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:18:27.588001 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-25870a8e-9320-4e27-9e9f-64699e9f43bb tempest-TestSecurityGroupsBasicOps-526761958 tempest-TestSecurityGroupsBasicOps-526761958-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:18:34.859631 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:19:21.911773 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-e6e837c7-b762-4ebf-b96e-177b6e86f995 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:19:21.912413 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e6e837c7-b762-4ebf-b96e-177b6e86f995 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:19:21.912683 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-e6e837c7-b762-4ebf-b96e-177b6e86f995 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:19:22.500938 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-e6e837c7-b762-4ebf-b96e-177b6e86f995 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] [instance: 217a832b-8703-4cc5-a5d1-ca6f703066b5] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99294) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 03:19:23.241604 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-e6e837c7-b762-4ebf-b96e-177b6e86f995 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Created allocations for migration 752e12a4-313f-4ab4-a1b3-a1c513f926b6 on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 03:19:23.653402 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-e6e837c7-b762-4ebf-b96e-177b6e86f995 tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] [instance: 217a832b-8703-4cc5-a5d1-ca6f703066b5] Calling prep_resize with selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [] {{(pid=99294) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 03:19:27.692518 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:19:29.609093 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:19:29.634789 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:19:29.635204 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:19:29.863355 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:19:29.863754 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:19:29.864690 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:19:29.865073 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:19:29.897411 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Getting quotas for project 8df1781bd9c04a47a9747923292b9eeb. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:19:29.902311 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Getting quotas for user 6ef35fd23078412591acd8f1a477b064 and project 8df1781bd9c04a47a9747923292b9eeb. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:19:29.920725 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] [instance: 41e33262-dbf8-405c-b966-26183c544238] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:19:29.921771 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:19:29.922237 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:19:29.986725 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] [instance: 41e33262-dbf8-405c-b966-26183c544238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:19:29.988045 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:19:29.988610 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:19:30.268306 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:19:30.268711 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7645249d-9e64-4135-a762-ca7ae765dc68 tempest-TestServerBasicOps-1910974602 tempest-TestServerBasicOps-1910974602-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:19:30.647880 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:19:31.672571 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 60696. Jun 10 03:19:50.908040 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:19:51.108125 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c5f3dd6c-7b8b-4577-892f-d0d3401019b4 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method unshelve_instance {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:19:51.109079 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c5f3dd6c-7b8b-4577-892f-d0d3401019b4 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:19:51.109611 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c5f3dd6c-7b8b-4577-892f-d0d3401019b4 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:19:51.827015 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c5f3dd6c-7b8b-4577-892f-d0d3401019b4 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] [instance: 11237c08-52e5-4f52-84bd-11f8e79eb784] Requesting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) during scheduling {{(pid=99294) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Jun 10 03:19:51.932630 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 60864. Jun 10 03:19:52.400517 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c5f3dd6c-7b8b-4577-892f-d0d3401019b4 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:19:52.422479 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-c5f3dd6c-7b8b-4577-892f-d0d3401019b4 tempest-AttachVolumeShelveTestJSON-817010124 tempest-AttachVolumeShelveTestJSON-817010124-project] Lazy-loading 'flavor' on Instance uuid 11237c08-52e5-4f52-84bd-11f8e79eb784 {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 03:21:21.763808 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Took 0.92 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:21:21.791816 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:21:21.792351 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:21:21.926611 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:21:21.926913 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:21:21.927849 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:21:21.928515 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:21:21.947148 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Getting quotas for project b0ddf6e10bac450ca3188e5d745555d2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:21:21.951725 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Getting quotas for user 3431e087f9b14ab2aacc18d6430a7873 and project b0ddf6e10bac450ca3188e5d745555d2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:21:21.963828 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] [instance: 4ad2583a-1604-4fec-a441-b2e0c63e69af] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:21:21.968359 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:21:21.968359 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:21:22.053822 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] [instance: 4ad2583a-1604-4fec-a441-b2e0c63e69af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:21:22.055184 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:21:22.055590 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:21:22.339151 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:21:22.339593 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8878664b-3707-4787-bc8f-07b6e639969c tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:21:54.877571 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:22:13.813099 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-40563e5f-90da-4baa-8b41-78e6bd1d563a tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:22:13.814005 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-40563e5f-90da-4baa-8b41-78e6bd1d563a tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:22:13.814709 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-40563e5f-90da-4baa-8b41-78e6bd1d563a tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:22:14.570012 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-40563e5f-90da-4baa-8b41-78e6bd1d563a tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Created allocations for migration 95c18478-a04a-4f46-bc58-c8de2a57016d on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 03:22:14.727679 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.live_migrate [None req-40563e5f-90da-4baa-8b41-78e6bd1d563a tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] [instance: 4ad2583a-1604-4fec-a441-b2e0c63e69af] Requesting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while live migrating {{(pid=99294) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:494}} Jun 10 03:22:15.409329 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-40563e5f-90da-4baa-8b41-78e6bd1d563a tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Lazy-loading 'resources' on Instance uuid 4ad2583a-1604-4fec-a441-b2e0c63e69af {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 03:22:15.414035 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-40563e5f-90da-4baa-8b41-78e6bd1d563a tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] Lazy-loading 'pci_requests' on Instance uuid 4ad2583a-1604-4fec-a441-b2e0c63e69af {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 03:22:15.928127 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.live_migrate [None req-40563e5f-90da-4baa-8b41-78e6bd1d563a tempest-TestNetworkAdvancedServerOps-292461275 tempest-TestNetworkAdvancedServerOps-292461275-project-admin] [instance: 4ad2583a-1604-4fec-a441-b2e0c63e69af] Start binding ports on destination host: n-h2-779913-11 {{(pid=99294) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jun 10 03:22:31.671821 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:22:32.693626 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 33908. Jun 10 03:22:47.709178 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:23:04.160343 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:23:04.184709 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:23:04.185120 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:23:04.344461 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:23:04.344461 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:23:04.344461 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:23:04.345318 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:23:04.364970 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Getting quotas for project b0ddf6e10bac450ca3188e5d745555d2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:23:04.371298 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Getting quotas for user 3431e087f9b14ab2aacc18d6430a7873 and project b0ddf6e10bac450ca3188e5d745555d2. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:23:04.384995 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] [instance: e17e05e0-8324-4456-8907-2c5fe1706149] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:23:04.386016 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:23:04.386482 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:23:04.450358 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] [instance: e17e05e0-8324-4456-8907-2c5fe1706149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:23:04.451929 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:23:04.452529 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:23:04.754022 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:23:04.755036 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f78c265-40c5-45d6-894c-fef87c910a94 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:23:52.622660 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c66b3055-c52a-4a09-bb8f-fdbc471d08b4 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method rebuild_instance {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:23:52.625750 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c66b3055-c52a-4a09-bb8f-fdbc471d08b4 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:23:52.627259 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c66b3055-c52a-4a09-bb8f-fdbc471d08b4 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:23:52.717973 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c66b3055-c52a-4a09-bb8f-fdbc471d08b4 tempest-TestNetworkAdvancedServerOps-390773398 tempest-TestNetworkAdvancedServerOps-390773398-project] [instance: e17e05e0-8324-4456-8907-2c5fe1706149] No migration record for the rebuild/evacuate request. {{(pid=99294) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jun 10 03:24:22.096755 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:24:23.114840 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 34708. Jun 10 03:24:39.878922 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:24:39.902114 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:24:39.902519 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:24:40.132938 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:24:40.133334 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:24:40.134046 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:24:40.134461 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:24:40.155648 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Getting quotas for project ddfd8d69b8bf4d9dadafbd044a79b20e. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:24:40.160871 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Getting quotas for user 5492fbc9e4b14f1281d88729942847cd and project ddfd8d69b8bf4d9dadafbd044a79b20e. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:24:40.172961 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] [instance: 602d41b7-1c69-4c37-8c88-c35a0e70e67c] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:24:40.173916 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:24:40.174336 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:24:40.282672 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] [instance: 602d41b7-1c69-4c37-8c88-c35a0e70e67c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:24:40.283898 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:24:40.284306 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:24:40.630833 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:24:40.631271 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b173b976-3cb3-4e7f-8c1a-43ee68b9a259 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:24:51.929451 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:24:52.946522 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 34972. Jun 10 03:24:59.921182 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:24:59.943823 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:24:59.944216 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:00.071913 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:00.072382 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:00.073019 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:00.073404 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:00.089904 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Getting quotas for project ddfd8d69b8bf4d9dadafbd044a79b20e. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:25:00.094990 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Getting quotas for user 5492fbc9e4b14f1281d88729942847cd and project ddfd8d69b8bf4d9dadafbd044a79b20e. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:25:00.105935 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] [instance: 3a974b1e-0650-49fa-bbc4-cc74653f369d] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:25:00.106861 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:00.107276 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:00.155975 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] [instance: 3a974b1e-0650-49fa-bbc4-cc74653f369d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:25:00.157819 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:00.158224 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:00.367309 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:00.367721 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-573410f4-03c8-43a4-9280-0cebe34fef75 tempest-VolumesActionsTest-1231312743 tempest-VolumesActionsTest-1231312743-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:21.044675 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:25:21.087344 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:21.087785 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:21.339163 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:21.339576 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:21.340322 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:21.340693 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:21.371265 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Getting quotas for project 25171fcc45654686bffa3d392f4dd6e7. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:25:21.378558 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Getting quotas for user aa82a182cabf494cbb4c928b86c78d26 and project 25171fcc45654686bffa3d392f4dd6e7. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:25:21.394915 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] [instance: 15c187f1-036e-477d-8b14-3e5cf26d5fb1] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:25:21.396243 n-d-779913-11 nova-conductor[99293]: DEBUG nova.scheduler.utils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-779913-11']) and/or node ([]) {{(pid=99293) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} Jun 10 03:25:21.397503 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:21.398340 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:21.658544 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] [instance: 15c187f1-036e-477d-8b14-3e5cf26d5fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:25:21.658544 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:21.658544 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:21.942717 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:21.943390 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-6849e216-bbea-4e35-9697-c23851e469dc tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:32.693518 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:25:33.712557 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 35360. Jun 10 03:25:44.189137 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:25:44.244929 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:44.245355 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:44.394199 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:44.394581 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:44.395322 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:44.395702 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:44.429204 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Getting quotas for project 25171fcc45654686bffa3d392f4dd6e7. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:25:44.442083 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Getting quotas for user aa82a182cabf494cbb4c928b86c78d26 and project 25171fcc45654686bffa3d392f4dd6e7. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:25:44.465052 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] [instance: 4a4fd89a-9862-4f50-9f96-cf540e973da3] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:25:44.465600 n-d-779913-11 nova-conductor[99294]: DEBUG nova.scheduler.utils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-779913-11']) and/or node ([]) {{(pid=99294) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} Jun 10 03:25:44.466384 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:44.466774 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:44.535631 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] [instance: 4a4fd89a-9862-4f50-9f96-cf540e973da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:25:44.536893 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:44.537294 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:25:44.885368 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:25:44.885859 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-c8e82ab8-51fe-4028-8ca2-cda5b5093f5b tempest-TestServerMultinode-1419437321 tempest-TestServerMultinode-1419437321-project-admin] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:26:07.729253 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:26:08.233282 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:26:08.258146 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:26:08.258465 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:26:08.533659 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:26:08.533875 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:26:08.534653 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:26:08.535221 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:26:08.552567 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:26:08.557122 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for user 371e7d95eabd42cc9734cfcd3a376a2c and project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:26:08.568216 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: 2dfae6a7-8a24-40f5-a9a3-fd732976d8dc] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:26:08.569153 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:26:08.569553 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:26:08.662213 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: 2dfae6a7-8a24-40f5-a9a3-fd732976d8dc] block_device_mapping [BlockDeviceMapping(attachment_id=811a452c-47b1-496a-9034-c82566a290b2,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b78efbe-2821-44e8-ba5b-2be95dc9f622',volume_size=1,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:26:08.663554 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:26:08.663968 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:26:08.903638 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:26:08.904571 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-2f24f05a-3f30-4b15-9205-6c87a6b9ed19 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:26:54.896033 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:27:04.794992 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:27:04.807771 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:27:04.808172 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:27:04.917402 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:27:04.917798 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:27:04.918546 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:27:04.918926 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:27:04.934740 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:27:04.939292 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for user 371e7d95eabd42cc9734cfcd3a376a2c and project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:27:04.949720 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: b2b5fbae-eca5-44dc-86df-03c8a4092ecd] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:27:04.950659 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:27:04.951093 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:27:05.020624 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: b2b5fbae-eca5-44dc-86df-03c8a4092ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8a977d34-f547-4e62-a672-4a607866c9ad',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:27:05.022438 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:27:05.022928 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:27:05.283629 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:27:05.284038 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f1869974-2c61-43c3-a69c-05c935d93b27 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:27:52.948662 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:27:53.966496 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36140. Jun 10 03:28:16.984690 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:28:18.001652 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36292. Jun 10 03:28:30.057075 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Took 2.49 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:28:30.078215 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:30.079183 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:30.188290 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:30.188778 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:30.189509 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:30.189907 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:30.205482 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:28:30.209898 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for user 371e7d95eabd42cc9734cfcd3a376a2c and project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:28:30.220335 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: 3dc106a7-9b8d-4599-b1b7-051a461d3bba] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:28:30.221280 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:30.221666 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:30.298043 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: 3dc106a7-9b8d-4599-b1b7-051a461d3bba] block_device_mapping [BlockDeviceMapping(attachment_id=68977a57-c1d6-451c-bcc5-f27ff74acc95,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f77b2c41-90ba-48f3-9e09-399e357c7ff3',volume_size=1,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:28:30.299479 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:30.299887 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:30.560571 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:30.560991 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-c57466ee-72e2-4ead-9fbd-dc619ce85600 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:33.718267 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:28:34.734790 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36372. Jun 10 03:28:57.652897 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:28:57.676156 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:57.676552 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:58.003524 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:58.003950 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:58.004672 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:58.005055 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:58.022481 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:28:58.027587 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for user 371e7d95eabd42cc9734cfcd3a376a2c and project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:28:58.038877 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: b520cee4-c0b7-4312-9336-919044e1486a] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:28:58.039788 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:58.040184 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:58.108206 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: b520cee4-c0b7-4312-9336-919044e1486a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3af0258f-4aec-4015-8c1b-624c886b74a1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:28:58.109454 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:58.109856 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:28:58.371214 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:28:58.371729 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-6ca49a8d-ea0c-46dc-a4ca-e1f6cd871412 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:29:27.748509 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:30:14.915666 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:30:35.029869 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:30:38.840693 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:30:38.945156 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:30:39.865689 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36888. Jun 10 03:30:41.194989 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:30:41.217333 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:30:41.217737 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:30:41.304057 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:30:41.304361 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:30:41.305068 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:30:41.305456 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:30:41.320763 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:30:41.325185 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for user 371e7d95eabd42cc9734cfcd3a376a2c and project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:30:41.335794 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: 3142e096-65b4-4494-9d8a-4bdbe2a5071d] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:30:41.336705 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:30:41.337097 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:30:41.396512 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: 3142e096-65b4-4494-9d8a-4bdbe2a5071d] block_device_mapping [BlockDeviceMapping(attachment_id=0fa3820d-ffba-4ed3-b2e9-cc0a000c9fea,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9867b5e0-40da-4dd0-8e3a-26efae8a8fa6',volume_size=1,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:30:41.397767 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:30:41.398165 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:30:41.636665 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:30:41.636974 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-3760f2eb-bcb8-4f65-917b-e32b5eb8a31e tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:30:53.966851 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:30:54.982735 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36942. Jun 10 03:31:18.001547 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:31:19.018224 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36972. Jun 10 03:31:34.734488 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:31:35.750310 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36982. Jun 10 03:32:47.766230 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:33:23.121012 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:33:24.136571 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37024. Jun 10 03:33:34.934464 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:33:36.846566 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:33:37.873494 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37094. Jun 10 03:33:39.504223 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [518ce486-decb-4082-b066-3fabfbd4b06c] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 03:33:40.518281 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [518ce486-decb-4082-b066-3fabfbd4b06c] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37114. Jun 10 03:33:42.932996 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Took 3.44 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:33:42.956203 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:33:42.956612 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:33:43.075259 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:33:43.075655 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:33:43.076457 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:33:43.076849 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:33:43.094348 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:33:43.098750 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for user 371e7d95eabd42cc9734cfcd3a376a2c and project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:33:43.109400 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: afff49da-53df-4f4e-b5aa-dbb166c84638] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:33:43.110557 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:33:43.110718 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:33:43.178689 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: afff49da-53df-4f4e-b5aa-dbb166c84638] block_device_mapping [BlockDeviceMapping(attachment_id=b2f15ee1-b8ed-4d62-9d73-f2b6c5dd6847,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9867b5e0-40da-4dd0-8e3a-26efae8a8fa6',volume_size=1,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:33:43.180016 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:33:43.180416 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:33:43.367502 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:33:43.367847 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:33:43.376821 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [bdbbac64-fbae-4835-a6f5-115bbd56b0ac] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 03:33:44.392150 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [None req-0b43d7b1-a6bb-485c-b3cd-1a0c80cc7ff2 tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [bdbbac64-fbae-4835-a6f5-115bbd56b0ac] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37146. Jun 10 03:33:54.982320 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:33:55.998541 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37182. Jun 10 03:34:35.751475 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:34:36.767707 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37230. Jun 10 03:35:39.863706 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:35:40.884740 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37254. Jun 10 03:35:41.142216 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:35:43.691408 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:36:07.784737 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:36:19.020858 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:36:20.040047 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37304. Jun 10 03:36:24.139021 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:36:25.161479 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37316. Jun 10 03:36:36.093350 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:36:36.119321 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:36:36.120620 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:36:36.258620 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:36:36.259096 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:36:36.260092 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:36:36.260662 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:36:36.279750 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:36:36.284590 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Getting quotas for user 371e7d95eabd42cc9734cfcd3a376a2c and project 2714f4b387424f4796a0bf053601c668. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:36:36.295717 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: b3ab6955-ae75-4a20-bf1b-a09fd8afdf3c] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:36:36.296673 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:36:36.297078 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:36:36.407422 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] [instance: b3ab6955-ae75-4a20-bf1b-a09fd8afdf3c] block_device_mapping [BlockDeviceMapping(attachment_id=9dcd659a-d127-4817-9eb0-33f224407dfe,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6adfec9c-da05-4bc0-bc18-7e4539e493ff',volume_size=1,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:36:36.408698 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:36:36.409125 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:36:36.670042 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:36:36.670370 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-da2c7643-3eb1-4df1-8bde-278b53e8636d tempest-TestVolumeBootPattern-60612624 tempest-TestVolumeBootPattern-60612624-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:36:54.950965 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:36:55.999647 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:36:57.016026 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37452. Jun 10 03:37:36.768336 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:37:37.786544 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37468. Jun 10 03:38:37.867686 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:38:38.889421 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37490. Jun 10 03:38:40.882769 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:38:41.905144 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37492. Jun 10 03:38:55.052098 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:38:58.966176 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:39:01.159562 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:39:03.707187 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:39:20.042455 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:39:21.059159 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37590. Jun 10 03:39:25.163262 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:39:26.179506 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37602. Jun 10 03:39:27.801803 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:39:54.941646 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:39:54.964051 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:39:54.965730 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:39:55.095878 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:39:55.096290 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:39:55.097015 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:39:55.097412 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:39:55.113524 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Getting quotas for project 459b8fe22a7e44f882bf5c398de99749. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:39:55.118017 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Getting quotas for user 12510f743a0841d6a9a8925c8922a407 and project 459b8fe22a7e44f882bf5c398de99749. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:39:55.128104 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] [instance: bf796ccf-3ec6-497a-9536-fa8de94d6fa4] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:39:55.129002 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:39:55.129462 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:39:55.204598 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] [instance: bf796ccf-3ec6-497a-9536-fa8de94d6fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:39:55.205795 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:39:55.206204 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:39:55.485001 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:39:55.485363 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9719b67d-c00f-4330-a026-59adf2a14086 tempest-ServersAdminNegativeTestJSON-324955364 tempest-ServersAdminNegativeTestJSON-324955364-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:39:57.018454 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:39:58.034287 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37732. Jun 10 03:40:14.967608 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:40:18.673579 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:40:18.699412 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:40:18.699823 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:40:18.885491 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:40:18.886063 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:40:18.886897 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:40:18.887450 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:40:18.904451 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Getting quotas for project 6ff0d1b112bc409896f6bfbf9b821d1c. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:40:18.909143 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Getting quotas for user 248408223f024999b9249e5921e37d8e and project 6ff0d1b112bc409896f6bfbf9b821d1c. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:40:18.920740 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] [instance: fc7666ff-cd86-4310-b731-e336cff44da3] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:40:18.921611 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:40:18.922017 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:40:18.959258 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] [instance: fc7666ff-cd86-4310-b731-e336cff44da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:40:18.960526 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:40:18.960937 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:40:19.177763 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:40:19.178099 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-cacd3a70-ed28-4d40-8da0-37efd8096498 tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:40:33.244116 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-d6192be3-8079-491a-8851-3c7d116b294d tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:40:33.244116 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d6192be3-8079-491a-8851-3c7d116b294d tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:40:33.244704 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d6192be3-8079-491a-8851-3c7d116b294d tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:40:33.553954 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-d6192be3-8079-491a-8851-3c7d116b294d tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] [instance: fc7666ff-cd86-4310-b731-e336cff44da3] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99294) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 03:40:34.030372 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-d6192be3-8079-491a-8851-3c7d116b294d tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] Created allocations for migration e4ffdd2d-781e-4778-9e11-2805b8052abf on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 03:40:34.360468 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-d6192be3-8079-491a-8851-3c7d116b294d tempest-DeleteServersTestJSON-1557274185 tempest-DeleteServersTestJSON-1557274185-project] [instance: fc7666ff-cd86-4310-b731-e336cff44da3] Calling prep_resize with selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [Selection(allocation_request='{"allocations": {"a6476fd0-f26b-421b-aa0f-9bdb0ef7b967": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["a6476fd0-f26b-421b-aa0f-9bdb0ef7b967"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=3a558ffc-c5f1-432a-9dcf-9c326fcb959c,compute_node_uuid=a6476fd0-f26b-421b-aa0f-9bdb0ef7b967,limits=SchedulerLimits,nodename='n-h2-779913-11',service_host='n-h2-779913-11')] {{(pid=99294) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 03:40:37.789134 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:40:38.807432 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37946. Jun 10 03:41:23.593244 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:41:23.615505 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:41:23.615908 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:41:23.793454 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:41:23.793859 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:41:23.794579 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:41:23.794985 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:41:23.809908 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Getting quotas for project b9b7939adf4f4eb8bf713f104ad0d431. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:41:23.814330 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Getting quotas for user 3ebe5aa9b7a2448abd86ff396c3c951e and project b9b7939adf4f4eb8bf713f104ad0d431. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:41:23.825245 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] [instance: 380c7334-8439-431b-aaf3-dd49469fba80] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:41:23.826166 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:41:23.826561 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:41:23.890885 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] [instance: 380c7334-8439-431b-aaf3-dd49469fba80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:41:23.892098 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:41:23.892507 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:41:24.108330 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:41:24.108764 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-420299cb-31e2-4636-9067-a649085cf233 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:41:39.658786 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-9b8be368-245a-4bb0-b471-632c718b389a tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:41:39.659311 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9b8be368-245a-4bb0-b471-632c718b389a tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:41:39.659712 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-9b8be368-245a-4bb0-b471-632c718b389a tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:41:39.951898 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-9b8be368-245a-4bb0-b471-632c718b389a tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] [instance: 380c7334-8439-431b-aaf3-dd49469fba80] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99294) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 03:41:40.545166 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-9b8be368-245a-4bb0-b471-632c718b389a tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Created allocations for migration 835244df-5fbf-48ab-8de2-88e90930f484 on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 03:41:41.045036 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-9b8be368-245a-4bb0-b471-632c718b389a tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] [instance: 380c7334-8439-431b-aaf3-dd49469fba80] Calling prep_resize with selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [Selection(allocation_request='{"allocations": {"a6476fd0-f26b-421b-aa0f-9bdb0ef7b967": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["a6476fd0-f26b-421b-aa0f-9bdb0ef7b967"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=3a558ffc-c5f1-432a-9dcf-9c326fcb959c,compute_node_uuid=a6476fd0-f26b-421b-aa0f-9bdb0ef7b967,limits=SchedulerLimits,nodename='n-h2-779913-11',service_host='n-h2-779913-11')] {{(pid=99294) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 03:42:16.708195 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:42:16.732553 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:42:16.732961 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:42:16.878233 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:42:16.878631 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:42:16.879372 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:42:16.879757 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:42:16.895546 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Getting quotas for project b9b7939adf4f4eb8bf713f104ad0d431. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:42:16.900992 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Getting quotas for user 3ebe5aa9b7a2448abd86ff396c3c951e and project b9b7939adf4f4eb8bf713f104ad0d431. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:42:16.913787 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] [instance: b63446f1-f8a4-4ff2-83d3-ce47a6d2100f] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:42:16.914746 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:42:16.916078 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:42:17.010994 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] [instance: b63446f1-f8a4-4ff2-83d3-ce47a6d2100f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:42:17.012254 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:42:17.012661 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:42:17.251906 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:42:17.252470 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-8cadebc7-6bbd-43c9-9e5a-22fa296eafa7 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:42:30.563181 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-f2de1873-505f-4093-a6e2-c688514ae267 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:42:30.563681 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f2de1873-505f-4093-a6e2-c688514ae267 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:42:30.564105 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f2de1873-505f-4093-a6e2-c688514ae267 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:42:30.824619 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-f2de1873-505f-4093-a6e2-c688514ae267 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] [instance: b63446f1-f8a4-4ff2-83d3-ce47a6d2100f] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99294) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 03:42:31.333952 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-f2de1873-505f-4093-a6e2-c688514ae267 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] Created allocations for migration d4043b3f-ecbd-403d-96a2-fefc457bc221 on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 03:42:31.696207 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-f2de1873-505f-4093-a6e2-c688514ae267 tempest-ServerDiskConfigTestJSON-670637414 tempest-ServerDiskConfigTestJSON-670637414-project] [instance: b63446f1-f8a4-4ff2-83d3-ce47a6d2100f] Calling prep_resize with selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [Selection(allocation_request='{"allocations": {"a6476fd0-f26b-421b-aa0f-9bdb0ef7b967": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["a6476fd0-f26b-421b-aa0f-9bdb0ef7b967"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=3a558ffc-c5f1-432a-9dcf-9c326fcb959c,compute_node_uuid=a6476fd0-f26b-421b-aa0f-9bdb0ef7b967,limits=SchedulerLimits,nodename='n-h2-779913-11',service_host='n-h2-779913-11')] {{(pid=99294) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 03:42:47.819766 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:42:58.035488 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:42:59.052285 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38382. Jun 10 03:43:19.880586 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:43:19.903413 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:43:19.903812 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:43:20.091041 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:43:20.091450 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:43:20.092190 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:43:20.092588 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:43:20.107481 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Getting quotas for project 85f904b816604afc950ea49681cdcc77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:43:20.112089 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Getting quotas for user 6d893e5541f945d2bf160a9cd776ca80 and project 85f904b816604afc950ea49681cdcc77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:43:20.133655 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 01b07b12-8cc1-41ed-a76f-26b2dcf4be2e] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:43:20.134912 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:43:20.135254 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:43:20.222537 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 01b07b12-8cc1-41ed-a76f-26b2dcf4be2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:43:20.224173 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:43:20.224594 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:43:20.468532 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:43:20.468955 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ef0417cb-2724-489c-8a2c-90f85ced7679 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:43:34.983906 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:43:38.808787 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:43:39.824354 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38538. Jun 10 03:44:38.888218 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:44:39.909025 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38656. Jun 10 03:45:21.062603 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:45:22.078664 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38736. Jun 10 03:45:26.183747 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:45:27.200812 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38756. Jun 10 03:45:41.179260 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:45:41.903717 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:45:42.925728 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38796. Jun 10 03:45:43.727440 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:45:59.053583 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:46:00.070691 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38830. Jun 10 03:46:06.760349 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-81015823-825c-4270-94c3-404f95c14019 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:46:06.761154 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-81015823-825c-4270-94c3-404f95c14019 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:46:06.761254 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-81015823-825c-4270-94c3-404f95c14019 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:46:07.046551 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-81015823-825c-4270-94c3-404f95c14019 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 01b07b12-8cc1-41ed-a76f-26b2dcf4be2e] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99294) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 03:46:07.595410 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-81015823-825c-4270-94c3-404f95c14019 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Created allocations for migration 75785099-3fb0-4a9f-82ff-9de20a680d29 on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 03:46:07.836401 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:46:07.924049 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-81015823-825c-4270-94c3-404f95c14019 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 01b07b12-8cc1-41ed-a76f-26b2dcf4be2e] Calling prep_resize with selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [Selection(allocation_request='{"allocations": {"a6476fd0-f26b-421b-aa0f-9bdb0ef7b967": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["a6476fd0-f26b-421b-aa0f-9bdb0ef7b967"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=3a558ffc-c5f1-432a-9dcf-9c326fcb959c,compute_node_uuid=a6476fd0-f26b-421b-aa0f-9bdb0ef7b967,limits=SchedulerLimits,nodename='n-h2-779913-11',service_host='n-h2-779913-11')] {{(pid=99294) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 03:46:38.100840 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:46:38.123539 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:46:38.123948 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:46:38.243330 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:46:38.243742 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:46:38.244476 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:46:38.245032 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:46:38.260045 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Getting quotas for project 85f904b816604afc950ea49681cdcc77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:46:38.264497 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Getting quotas for user 6d893e5541f945d2bf160a9cd776ca80 and project 85f904b816604afc950ea49681cdcc77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:46:38.275138 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 6790b201-acae-4e85-a3cc-d512c4aeee3d] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:46:38.276527 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:46:38.277238 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:46:38.415561 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 6790b201-acae-4e85-a3cc-d512c4aeee3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:46:38.417416 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:46:38.417857 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:46:38.787534 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:46:38.787943 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-a11cc47b-612f-4a28-8ac1-2460d6d383b3 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:46:39.826370 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:46:40.843176 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 38984. Jun 10 03:46:55.000386 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:48:27.201242 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:48:28.218238 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39204. Jun 10 03:48:39.905665 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:48:40.867923 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-46f44a42-9a19-4a3b-8dc9-04ee8ad3c579 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:48:40.868449 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-46f44a42-9a19-4a3b-8dc9-04ee8ad3c579 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:48:40.868881 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-46f44a42-9a19-4a3b-8dc9-04ee8ad3c579 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:48:40.931721 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39236. Jun 10 03:48:41.350127 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-46f44a42-9a19-4a3b-8dc9-04ee8ad3c579 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 6790b201-acae-4e85-a3cc-d512c4aeee3d] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99293) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 03:48:41.811378 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-46f44a42-9a19-4a3b-8dc9-04ee8ad3c579 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Created allocations for migration 9cf7c28c-32eb-4459-abab-338a6bc2c5f7 on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99293) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 03:48:42.140099 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-46f44a42-9a19-4a3b-8dc9-04ee8ad3c579 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 6790b201-acae-4e85-a3cc-d512c4aeee3d] Calling prep_resize with selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [Selection(allocation_request='{"allocations": {"31af5d91-4a28-44aa-87b2-ca38c3499d20": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["31af5d91-4a28-44aa-87b2-ca38c3499d20"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=3a558ffc-c5f1-432a-9dcf-9c326fcb959c,compute_node_uuid=31af5d91-4a28-44aa-87b2-ca38c3499d20,limits=SchedulerLimits,nodename='n-h1-779913-11',service_host='n-h1-779913-11')] {{(pid=99293) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 03:49:00.070376 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:49:01.088567 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39330. Jun 10 03:49:01.195378 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:49:03.751510 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:49:07.585537 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:49:07.608567 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:49:07.608901 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:49:07.752607 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:49:07.753015 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:49:07.753754 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:49:07.754146 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:49:07.771599 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Getting quotas for project 85f904b816604afc950ea49681cdcc77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:49:07.776055 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Getting quotas for user 6d893e5541f945d2bf160a9cd776ca80 and project 85f904b816604afc950ea49681cdcc77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:49:07.787333 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: cd93c304-4037-4998-97af-3aa5660d6423] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:49:07.788284 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:49:07.788687 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:49:07.847834 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: cd93c304-4037-4998-97af-3aa5660d6423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:49:07.849130 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:49:07.849563 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:49:08.105106 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:49:08.105625 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-97670f0e-90b3-4961-88e5-996bd97ccc63 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:49:27.853413 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:49:40.843411 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:49:41.858068 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39452. Jun 10 03:50:15.016601 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:50:57.382522 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-f6589c16-2201-4aa1-be45-ccc9e3a2a16e tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:50:57.383197 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f6589c16-2201-4aa1-be45-ccc9e3a2a16e tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:50:57.383444 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-f6589c16-2201-4aa1-be45-ccc9e3a2a16e tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:50:57.654901 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-f6589c16-2201-4aa1-be45-ccc9e3a2a16e tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: cd93c304-4037-4998-97af-3aa5660d6423] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99294) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 03:50:58.180129 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-f6589c16-2201-4aa1-be45-ccc9e3a2a16e tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Created allocations for migration 8eed7095-82d3-45e1-ad80-69b06b793d48 on 31af5d91-4a28-44aa-87b2-ca38c3499d20 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 03:50:58.553662 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-f6589c16-2201-4aa1-be45-ccc9e3a2a16e tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: cd93c304-4037-4998-97af-3aa5660d6423] Calling prep_resize with selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [Selection(allocation_request='{"allocations": {"31af5d91-4a28-44aa-87b2-ca38c3499d20": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["31af5d91-4a28-44aa-87b2-ca38c3499d20"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=3a558ffc-c5f1-432a-9dcf-9c326fcb959c,compute_node_uuid=31af5d91-4a28-44aa-87b2-ca38c3499d20,limits=SchedulerLimits,nodename='n-h1-779913-11',service_host='n-h1-779913-11')] {{(pid=99294) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 03:51:22.083221 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:51:23.098816 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39680. Jun 10 03:51:37.993170 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:51:38.018033 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:51:38.018033 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:51:38.134710 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:51:38.135149 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:51:38.135872 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:51:38.136266 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:51:38.151927 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Getting quotas for project 85f904b816604afc950ea49681cdcc77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:51:38.157304 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Getting quotas for user 6d893e5541f945d2bf160a9cd776ca80 and project 85f904b816604afc950ea49681cdcc77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:51:38.172555 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 9e044290-80d5-4b98-b0bb-d53ba8ff9ac1] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:51:38.173526 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:51:38.173919 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:51:38.251518 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 9e044290-80d5-4b98-b0bb-d53ba8ff9ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:51:38.253361 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:51:38.253732 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:51:38.519870 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:51:38.520180 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-58d30657-e4a1-4f24-a0d5-00d5cb3527c7 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:52:01.089409 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:52:02.105612 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39802. Jun 10 03:52:41.860273 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:52:42.875469 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39886. Jun 10 03:52:47.870964 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:53:28.221744 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:53:29.239302 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39982. Jun 10 03:53:35.036004 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:53:40.929131 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:53:41.950351 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40012. Jun 10 03:53:42.925517 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:53:43.946863 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40018. Jun 10 03:53:55.081187 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 10 03:53:58.993639 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 10 03:54:01.213119 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:54:03.771279 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:54:23.100606 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:54:24.116754 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40122. Jun 10 03:54:45.137947 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-2bad2b78-49b4-48c3-a1a3-f69a2c396c84 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 03:54:45.138450 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2bad2b78-49b4-48c3-a1a3-f69a2c396c84 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:54:45.138826 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2bad2b78-49b4-48c3-a1a3-f69a2c396c84 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:54:45.431369 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-2bad2b78-49b4-48c3-a1a3-f69a2c396c84 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 9e044290-80d5-4b98-b0bb-d53ba8ff9ac1] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99294) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 03:54:45.878546 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-2bad2b78-49b4-48c3-a1a3-f69a2c396c84 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] Created allocations for migration e46a2307-5fb2-4b9c-b4bb-1f7f88e3a976 on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99294) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 03:54:46.281944 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.tasks.migrate [None req-2bad2b78-49b4-48c3-a1a3-f69a2c396c84 tempest-ServerActionsTestJSON-1480188237 tempest-ServerActionsTestJSON-1480188237-project] [instance: 9e044290-80d5-4b98-b0bb-d53ba8ff9ac1] Calling prep_resize with selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [Selection(allocation_request='{"allocations": {"a6476fd0-f26b-421b-aa0f-9bdb0ef7b967": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["a6476fd0-f26b-421b-aa0f-9bdb0ef7b967"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=3a558ffc-c5f1-432a-9dcf-9c326fcb959c,compute_node_uuid=a6476fd0-f26b-421b-aa0f-9bdb0ef7b967,limits=SchedulerLimits,nodename='n-h2-779913-11',service_host='n-h2-779913-11')] {{(pid=99294) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 03:55:02.106427 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:55:03.122479 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40248. Jun 10 03:55:42.877723 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:55:43.894796 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40304. Jun 10 03:56:07.887632 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:56:43.943821 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 03:56:44.971128 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40388. Jun 10 03:56:52.301853 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:56:52.327504 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:56:52.330546 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:56:52.482884 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:56:52.483309 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:56:52.484021 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:56:52.484400 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:56:52.502709 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Getting quotas for project fb754eb7d75d419daec25536de4feaae. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:56:52.507194 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Getting quotas for user 11432d6b00554983b5ce6559e5ef3436 and project fb754eb7d75d419daec25536de4feaae. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:56:52.518280 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] [instance: 402881a3-a669-464b-8908-4849fd85ed99] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:56:52.519239 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:56:52.519629 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:56:52.586479 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] [instance: 402881a3-a669-464b-8908-4849fd85ed99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:56:52.587685 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:56:52.588087 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:56:52.866289 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:56:52.866602 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-8a93b8ba-66b8-4dd2-b5ee-24ad9f15aea6 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:56:55.052748 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 03:57:06.444656 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] [518ce486-decb-4082-b066-3fabfbd4b06c] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 03:57:07.459537 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] [518ce486-decb-4082-b066-3fabfbd4b06c] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40502. Jun 10 03:57:10.087872 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Took 3.65 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:57:10.109709 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:57:10.110115 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:57:10.231960 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:57:10.232368 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:57:10.233099 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:57:10.233496 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:57:10.249821 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Getting quotas for project fb754eb7d75d419daec25536de4feaae. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:57:10.254903 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Getting quotas for user 11432d6b00554983b5ce6559e5ef3436 and project fb754eb7d75d419daec25536de4feaae. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:57:10.265106 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] [instance: 928d1cec-db64-4752-9ec0-95308f358b2c] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:57:10.266024 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:57:10.266431 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:57:10.329343 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] [instance: 928d1cec-db64-4752-9ec0-95308f358b2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:57:10.330835 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:57:10.331283 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:57:10.581181 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:57:10.581509 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:57:10.590340 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] [bdbbac64-fbae-4835-a6f5-115bbd56b0ac] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 03:57:11.605787 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [None req-aa2d0657-da78-4e84-b156-eb18fd841810 tempest-ServersNegativeTestJSON-2103137872 tempest-ServersNegativeTestJSON-2103137872-project] [bdbbac64-fbae-4835-a6f5-115bbd56b0ac] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40528. Jun 10 03:58:03.124469 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:58:04.142182 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40734. Jun 10 03:58:25.377989 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:58:25.401449 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:58:25.402178 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:58:25.605755 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:58:25.606150 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:58:25.606860 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:58:25.607269 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:58:25.622467 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Getting quotas for project d61d95a10a5e4d0d95ee41f1f9405e77. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:58:25.627173 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Getting quotas for user fb9a0a454a6f488cb52e455dbd177899 and project d61d95a10a5e4d0d95ee41f1f9405e77. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:58:25.638208 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] [instance: c0e1e43c-bb57-44d3-b8a4-42b177c9936d] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:58:25.639288 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:58:25.639686 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:58:25.718181 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] [instance: c0e1e43c-bb57-44d3-b8a4-42b177c9936d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:58:25.718181 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:58:25.718181 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:58:25.984501 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:58:25.984909 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-d39ba014-c3d9-4111-8785-f5b992e655cf tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:58:43.896397 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 03:58:44.912679 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40904. Jun 10 03:59:06.676190 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 03:59:06.699125 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:59:06.699528 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:59:06.828683 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:59:06.829088 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:59:06.829826 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:59:06.830209 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:59:06.846239 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Getting quotas for project d61d95a10a5e4d0d95ee41f1f9405e77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 03:59:06.850720 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Getting quotas for user fb9a0a454a6f488cb52e455dbd177899 and project d61d95a10a5e4d0d95ee41f1f9405e77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 03:59:06.862330 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] [instance: 2845e6c7-8318-46cb-b565-5ae6af7efd0f] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 03:59:06.863303 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:59:06.863707 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:59:06.932572 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] [instance: 2845e6c7-8318-46cb-b565-5ae6af7efd0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 03:59:06.933749 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:59:06.934197 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:59:07.138657 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 03:59:07.139123 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-ff609011-af96-4d13-b223-7552ff8950da tempest-TestEncryptedCinderVolumes-1035235861 tempest-TestEncryptedCinderVolumes-1035235861-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 03:59:27.904532 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:00:15.070237 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:00:29.243823 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:00:30.264057 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41256. Jun 10 04:00:32.690155 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:00:32.712965 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:00:32.713373 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:00:33.042557 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:00:33.042925 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:00:33.043684 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:00:33.044082 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:00:33.059733 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Getting quotas for project 9e05107b643e4ffdae33172786bd4e45. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 04:00:33.065188 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Getting quotas for user 9043c2c247f84cac9aa2e5a8e610a6d9 and project 9e05107b643e4ffdae33172786bd4e45. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 04:00:33.075547 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] [instance: f19e6a9a-9cfd-4e00-a913-b6c6b296ab80] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 04:00:33.077316 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:00:33.077726 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:00:33.158999 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] [instance: f19e6a9a-9cfd-4e00-a913-b6c6b296ab80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60e54583-19e7-4f5a-bba9-04e63842e244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 04:00:33.160310 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:00:33.160720 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:00:33.336819 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:00:33.337139 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-7f885147-89d1-4e48-b09d-1e1fa53aa12e tempest-TestMinimumBasicScenario-975589412 tempest-TestMinimumBasicScenario-975589412-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:01:04.142601 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:01:05.159349 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41410. Jun 10 04:01:24.121870 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:01:25.140810 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41462. Jun 10 04:01:44.913323 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:01:44.966389 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:01:45.930361 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41498. Jun 10 04:01:45.987292 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41500. Jun 10 04:02:15.101395 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:02:19.015896 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:02:41.953151 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:02:42.978069 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41634. Jun 10 04:02:47.921023 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:03:04.511007 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:03:04.535342 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:03:04.535941 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:03:04.743637 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:03:04.744044 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:03:04.744769 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:03:04.745152 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:03:04.760955 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Getting quotas for project eb89dfbb43ae4a86a201dca5be125ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 04:03:04.765709 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Getting quotas for user 3d894af666324db5bff659ff249f40ea and project eb89dfbb43ae4a86a201dca5be125ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 04:03:04.776753 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: e9fbe543-aca0-401f-a886-ab114fcc2579] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 04:03:04.777694 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:03:04.778124 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:03:04.864193 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: e9fbe543-aca0-401f-a886-ab114fcc2579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 04:03:04.865492 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:03:04.866079 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:03:05.148625 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:03:05.149035 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-7cb9580a-157b-4a09-bf92-91645bc759fa tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:03:30.262394 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:03:31.280445 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41804. Jun 10 04:03:35.089882 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:04:05.159551 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:04:06.175441 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41822. Jun 10 04:04:45.931483 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:04:46.952401 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41914. Jun 10 04:04:51.797885 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:04:51.822797 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:04:51.823234 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:04:51.975468 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:04:51.976869 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:04:51.977670 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:04:51.978061 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:04:51.996477 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Getting quotas for project eb89dfbb43ae4a86a201dca5be125ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 04:04:52.002227 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Getting quotas for user 3d894af666324db5bff659ff249f40ea and project eb89dfbb43ae4a86a201dca5be125ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 04:04:52.015059 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: e8fd9bbf-49c5-49c3-aabf-3b2b7d76f666] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 04:04:52.016002 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:04:52.016541 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:04:52.106753 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: e8fd9bbf-49c5-49c3-aabf-3b2b7d76f666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 04:04:52.108061 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:04:52.108605 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:04:52.387069 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:04:52.387565 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-314e2483-9956-418f-8ae4-3a8ba4493053 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:05:25.141506 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:05:26.157193 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41988. Jun 10 04:05:35.117812 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:05:39.032898 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:05:45.984556 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:05:47.006279 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42008. Jun 10 04:06:07.937796 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:06:55.105135 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:07:06.176339 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:07:07.191670 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42062. Jun 10 04:07:21.239349 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:07:23.797635 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:07:31.282594 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:07:32.299674 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42118. Jun 10 04:07:42.973835 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:07:43.898585 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:07:43.925099 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:07:43.925099 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:07:43.994038 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42172. Jun 10 04:07:44.055194 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:07:44.055600 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:07:44.056323 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:07:44.056718 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:07:44.072282 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Getting quotas for project eb89dfbb43ae4a86a201dca5be125ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 04:07:44.076971 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Getting quotas for user 3d894af666324db5bff659ff249f40ea and project eb89dfbb43ae4a86a201dca5be125ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 04:07:44.087986 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: 4b365e4e-ece8-46df-a2ab-ecf44ffb7b56] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 04:07:44.088928 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:07:44.089338 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:07:44.180865 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: 4b365e4e-ece8-46df-a2ab-ecf44ffb7b56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 04:07:44.182145 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:07:44.182559 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:07:44.443862 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:07:44.444281 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-72c96fad-6149-4357-83fa-be6243b5d1d6 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:07:46.952808 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:07:47.974004 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42182. Jun 10 04:09:03.894587 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-3681e957-b133-4903-aadc-bd0803574729 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method migrate_server {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 04:09:03.895266 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3681e957-b133-4903-aadc-bd0803574729 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:09:03.895496 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-3681e957-b133-4903-aadc-bd0803574729 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:09:04.206817 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-3681e957-b133-4903-aadc-bd0803574729 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: 4b365e4e-ece8-46df-a2ab-ecf44ffb7b56] Restricting to cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) while migrating {{(pid=99293) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Jun 10 04:09:04.730358 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-3681e957-b133-4903-aadc-bd0803574729 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Created allocations for migration 787a9c4d-35dd-4187-909a-2c157ada784f on a6476fd0-f26b-421b-aa0f-9bdb0ef7b967 {{(pid=99293) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jun 10 04:09:05.167235 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.tasks.migrate [None req-3681e957-b133-4903-aadc-bd0803574729 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: 4b365e4e-ece8-46df-a2ab-ecf44ffb7b56] Calling prep_resize with selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [Selection(allocation_request='{"allocations": {"a6476fd0-f26b-421b-aa0f-9bdb0ef7b967": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["a6476fd0-f26b-421b-aa0f-9bdb0ef7b967"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=3a558ffc-c5f1-432a-9dcf-9c326fcb959c,compute_node_uuid=a6476fd0-f26b-421b-aa0f-9bdb0ef7b967,limits=SchedulerLimits,nodename='n-h2-779913-11',service_host='n-h2-779913-11')] {{(pid=99293) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Jun 10 04:09:27.965850 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:10:07.192232 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:10:08.231559 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42378. Jun 10 04:10:15.121173 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:10:22.553367 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [e839d07f-4b54-40bc-ad27-b8c5526da95c] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 04:10:23.570229 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [e839d07f-4b54-40bc-ad27-b8c5526da95c] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42448. Jun 10 04:10:23.911411 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Took 1.36 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:10:23.937875 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:10:23.938281 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:10:24.061792 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:10:24.061792 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:10:24.061792 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:10:24.061792 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:10:24.077488 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Getting quotas for project eb89dfbb43ae4a86a201dca5be125ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 04:10:24.082203 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Getting quotas for user 3d894af666324db5bff659ff249f40ea and project eb89dfbb43ae4a86a201dca5be125ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 04:10:24.094038 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: 1ef5f2a1-23c4-4d86-b7f9-a50d29a4ff58] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 04:10:24.095080 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:10:24.095491 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:10:24.140134 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: 1ef5f2a1-23c4-4d86-b7f9-a50d29a4ff58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 04:10:24.141921 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:10:24.142332 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:10:24.324228 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:10:24.324842 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:10:24.336240 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [e6bada0e-c9ec-4291-905f-40a1930b4abe] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 04:10:25.352185 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f67b05b-fec0-4d03-9aba-c25ce17e8195 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [e6bada0e-c9ec-4291-905f-40a1930b4abe] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42462. Jun 10 04:10:47.972303 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:10:48.988347 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42510. Jun 10 04:11:26.161574 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:11:27.177250 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42522. Jun 10 04:11:47.004586 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:11:48.029155 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42530. Jun 10 04:12:15.137534 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:12:19.051278 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:12:32.301727 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:12:33.318576 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42576. Jun 10 04:12:43.992551 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:12:45.016449 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42586. Jun 10 04:12:47.983484 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:13:08.232678 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:13:09.250925 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42618. Jun 10 04:13:29.285949 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:13:29.313797 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:13:29.314212 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:13:29.441898 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:13:29.442742 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:13:29.444163 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:13:29.445034 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:13:29.469681 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Getting quotas for project eb89dfbb43ae4a86a201dca5be125ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 04:13:29.475793 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Getting quotas for user 3d894af666324db5bff659ff249f40ea and project eb89dfbb43ae4a86a201dca5be125ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 04:13:29.487014 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: ab1210d3-993d-4e1b-94cf-42e1b4067021] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 04:13:29.487980 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:13:29.488553 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:13:29.556215 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] [instance: ab1210d3-993d-4e1b-94cf-42e1b4067021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 04:13:29.557526 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:13:29.557967 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:13:29.843742 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:13:29.844265 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-487b041f-ca14-4900-b6e3-aba8977b7743 tempest-TestNetworkAdvancedServerOps-2093093270 tempest-TestNetworkAdvancedServerOps-2093093270-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:13:35.138797 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:13:48.989397 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:13:50.005047 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42744. Jun 10 04:15:33.318638 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:15:34.336663 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42906. Jun 10 04:15:40.113494 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] [e839d07f-4b54-40bc-ad27-b8c5526da95c] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 04:15:41.127398 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] [e839d07f-4b54-40bc-ad27-b8c5526da95c] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42948. Jun 10 04:15:41.779426 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Took 1.67 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:15:41.802030 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:15:41.802435 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:15:41.973027 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:15:41.973356 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:15:41.974075 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:15:41.974473 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:15:41.990397 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Getting quotas for project e86ba7f76ce64f98aa49a3621b497c77. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 04:15:41.994776 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Getting quotas for user 808f1c03928c4b67b6fc746fa6861af1 and project e86ba7f76ce64f98aa49a3621b497c77. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 04:15:42.006363 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] [instance: e0a1dc61-417b-4546-8f9f-f248164720d3] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 04:15:42.006969 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:15:42.007368 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:15:42.080879 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] [instance: e0a1dc61-417b-4546-8f9f-f248164720d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 04:15:42.082137 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:15:42.082556 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:15:42.338435 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:15:42.339146 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:15:42.349981 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] [e6bada0e-c9ec-4291-905f-40a1930b4abe] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 04:15:43.364008 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [None req-34083571-f961-4ad3-b92a-ce035bb9e050 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] [e6bada0e-c9ec-4291-905f-40a1930b4abe] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42966. Jun 10 04:15:48.027735 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:15:49.049287 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42982. Jun 10 04:16:08.000171 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:16:09.251537 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:16:10.266951 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43016. Jun 10 04:16:27.180799 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:16:28.196649 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43022. Jun 10 04:16:50.006229 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:16:51.023086 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43030. Jun 10 04:16:55.158173 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:17:45.015914 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:17:46.037173 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43044. Jun 10 04:18:34.337019 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:18:35.352378 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43092. Jun 10 04:18:49.046527 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:18:50.072553 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43164. Jun 10 04:18:55.157407 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:18:59.070054 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:18:59.864426 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-de293a6d-967a-4373-bf10-15a55d567b91 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method unshelve_instance {{(pid=99294) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 04:18:59.864975 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-de293a6d-967a-4373-bf10-15a55d567b91 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:18:59.865298 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-de293a6d-967a-4373-bf10-15a55d567b91 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:19:00.483810 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-de293a6d-967a-4373-bf10-15a55d567b91 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] [instance: e0a1dc61-417b-4546-8f9f-f248164720d3] Requesting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) during scheduling {{(pid=99294) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Jun 10 04:19:00.809567 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-de293a6d-967a-4373-bf10-15a55d567b91 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:19:00.817608 n-d-779913-11 nova-conductor[99294]: DEBUG nova.objects.instance [None req-de293a6d-967a-4373-bf10-15a55d567b91 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lazy-loading 'flavor' on Instance uuid e0a1dc61-417b-4546-8f9f-f248164720d3 {{(pid=99294) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 04:19:10.269021 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:19:11.286707 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43278. Jun 10 04:19:28.015588 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:19:28.197420 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:19:29.213647 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43348. Jun 10 04:19:51.023256 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:19:52.038223 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43356. Jun 10 04:20:15.173879 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:21:35.353601 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:21:36.369033 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43556. Jun 10 04:21:44.247986 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:21:44.270987 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:21:44.274644 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:21:44.424880 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:21:44.425278 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:21:44.425992 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:21:44.426375 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:21:44.442198 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Getting quotas for project e86ba7f76ce64f98aa49a3621b497c77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 04:21:44.446594 n-d-779913-11 nova-conductor[99293]: DEBUG nova.quota [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Getting quotas for user 808f1c03928c4b67b6fc746fa6861af1 and project e86ba7f76ce64f98aa49a3621b497c77. Resources: {'ram', 'instances', 'cores'} {{(pid=99293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 04:21:44.456784 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] [instance: 2bdeb3f1-8d0e-4bca-8eea-bc1d6d3136ab] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99293) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 04:21:44.457638 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:21:44.458108 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:21:44.522414 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] [instance: 2bdeb3f1-8d0e-4bca-8eea-bc1d6d3136ab] block_device_mapping [BlockDeviceMapping(attachment_id=cbf2d0ce-97ca-486a-b41a-ee2e73ddaeb3,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ac342f3-6686-4919-a07e-f0c8ce330582',volume_size=1,volume_type=None)] {{(pid=99293) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 04:21:44.523917 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:21:44.524319 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:21:44.747551 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:21:44.747953 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-b4947e2f-45cc-4ccc-95ae-c229b25b17c2 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:21:46.034734 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:21:47.058262 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43618. Jun 10 04:22:11.287545 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:22:12.304001 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43676. Jun 10 04:22:48.058458 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:22:52.039313 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:22:53.055386 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43706. Jun 10 04:23:35.189500 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:23:50.067644 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:23:51.089376 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43732. Jun 10 04:23:55.175845 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:23:59.088162 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:24:01.268367 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:24:03.827399 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:24:29.216664 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:24:30.232741 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43754. Jun 10 04:24:36.369609 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:24:37.385556 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43778. Jun 10 04:24:47.054564 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:24:47.999211 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-efe04f0b-35c6-4ca3-a60e-52fb0ca4b437 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Targeting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) for conductor method unshelve_instance {{(pid=99293) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Jun 10 04:24:47.999716 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-efe04f0b-35c6-4ca3-a60e-52fb0ca4b437 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:24:48.000085 n-d-779913-11 nova-conductor[99293]: DEBUG oslo_concurrency.lockutils [None req-efe04f0b-35c6-4ca3-a60e-52fb0ca4b437 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:24:48.079303 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43810. Jun 10 04:24:48.238583 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-efe04f0b-35c6-4ca3-a60e-52fb0ca4b437 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] [instance: 2bdeb3f1-8d0e-4bca-8eea-bc1d6d3136ab] Requesting cell 3a558ffc-c5f1-432a-9dcf-9c326fcb959c(cell1) during scheduling {{(pid=99293) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Jun 10 04:24:48.559954 n-d-779913-11 nova-conductor[99293]: DEBUG nova.conductor.manager [None req-efe04f0b-35c6-4ca3-a60e-52fb0ca4b437 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99293) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:24:48.567454 n-d-779913-11 nova-conductor[99293]: DEBUG nova.objects.instance [None req-efe04f0b-35c6-4ca3-a60e-52fb0ca4b437 tempest-TestShelveInstance-327259103 tempest-TestShelveInstance-327259103-project] Lazy-loading 'flavor' on Instance uuid 2bdeb3f1-8d0e-4bca-8eea-bc1d6d3136ab {{(pid=99293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jun 10 04:25:12.304380 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:25:13.320112 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43872. Jun 10 04:25:53.057097 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:25:54.073848 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43886. Jun 10 04:26:08.074551 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:26:51.084644 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:26:52.110510 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43922. Jun 10 04:26:55.205932 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:27:15.191752 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:27:19.103799 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:27:21.284012 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:27:23.845740 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:27:30.234658 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:27:31.254080 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44068. Jun 10 04:27:33.116473 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:27:33.138450 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:27:33.138854 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:27:33.305005 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:27:33.305439 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:27:33.306216 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:27:33.306607 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:27:33.321879 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Getting quotas for project b2b5e10eabc24b07ac5a721afb49077a. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 04:27:33.326298 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Getting quotas for user 38108d3cbfc446bda9f6cb8513cefe83 and project b2b5e10eabc24b07ac5a721afb49077a. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 04:27:33.337946 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] [instance: 409f7d1a-a204-47ce-983f-fdd097b7034e] Selected host: n-h2-779913-11; Selected node: n-h2-779913-11; Alternates: [('n-h1-779913-11', 'n-h1-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 04:27:33.339120 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:27:33.339703 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:27:33.410443 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] [instance: 409f7d1a-a204-47ce-983f-fdd097b7034e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f58a44be-5960-4d06-a60d-6c8835ec904e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 04:27:33.411782 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:27:33.412182 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:27:33.655793 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:27:33.656208 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-2c435849-e536-4eba-b566-13beb26f5a5d tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:28:13.321535 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:28:14.337175 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44156. Jun 10 04:28:54.074261 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:28:55.089888 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44170. Jun 10 04:29:28.090963 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:29:37.388651 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:29:38.404176 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44182. Jun 10 04:29:48.076911 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:29:49.098268 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44188. Jun 10 04:29:52.103640 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:29:53.124244 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44190. Jun 10 04:30:15.225296 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:30:31.253495 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:30:32.272320 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44328. Jun 10 04:30:35.210099 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:30:39.125950 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:30:39.432419 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] [e839d07f-4b54-40bc-ad27-b8c5526da95c] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 04:30:40.447045 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] [e839d07f-4b54-40bc-ad27-b8c5526da95c] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44404. Jun 10 04:30:40.965896 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Took 1.54 seconds to select destinations for 1 instance(s). {{(pid=99294) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jun 10 04:30:40.988479 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:30:40.988890 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:30:41.180635 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:30:41.181051 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:30:41.181763 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:30:41.182169 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:30:41.196766 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Getting quotas for project b2b5e10eabc24b07ac5a721afb49077a. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jun 10 04:30:41.201165 n-d-779913-11 nova-conductor[99294]: DEBUG nova.quota [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Getting quotas for user 38108d3cbfc446bda9f6cb8513cefe83 and project b2b5e10eabc24b07ac5a721afb49077a. Resources: {'ram', 'instances', 'cores'} {{(pid=99294) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jun 10 04:30:41.211747 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] [instance: f2285a07-1116-4840-a6c3-b31ebb887922] Selected host: n-h1-779913-11; Selected node: n-h1-779913-11; Alternates: [('n-h2-779913-11', 'n-h2-779913-11')] {{(pid=99294) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jun 10 04:30:41.212559 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:30:41.212954 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:30:41.274617 n-d-779913-11 nova-conductor[99294]: DEBUG nova.conductor.manager [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] [instance: f2285a07-1116-4840-a6c3-b31ebb887922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4e35041c-949a-4768-8c4c-04705f5ac9d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99294) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jun 10 04:30:41.275877 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:30:41.276286 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:30:41.474904 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 10 04:30:41.475611 n-d-779913-11 nova-conductor[99294]: DEBUG oslo_concurrency.lockutils [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] Lock "3a558ffc-c5f1-432a-9dcf-9c326fcb959c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99294) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 10 04:30:41.484342 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] [e6bada0e-c9ec-4291-905f-40a1930b4abe] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 04:30:42.499871 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d67532b-07dd-4a01-bc3f-55be6780e8e7 tempest-TestSnapshotPattern-753199517 tempest-TestSnapshotPattern-753199517-project] [e6bada0e-c9ec-4291-905f-40a1930b4abe] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44430. Jun 10 04:31:14.339046 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:31:15.353573 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44518. Jun 10 04:31:55.091459 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:31:56.108275 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44542. Jun 10 04:32:48.106403 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:32:49.094525 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:32:50.114270 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44724. Jun 10 04:32:53.120518 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:32:54.142545 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44756. Jun 10 04:33:32.272529 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:33:33.288726 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44862. Jun 10 04:33:35.241438 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:33:38.407516 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:33:39.423801 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44866. Jun 10 04:33:55.230113 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:33:59.142102 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:34:15.354298 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:34:16.370403 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44882. Jun 10 04:34:56.109328 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:34:57.124374 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44892. Jun 10 04:35:41.313630 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:35:43.871106 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:35:50.110459 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:35:51.132896 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44904. Jun 10 04:35:54.137251 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:35:55.158419 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44908. Jun 10 04:36:08.122759 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:36:33.290114 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:36:34.305301 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44916. Jun 10 04:36:39.424507 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:36:40.440149 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44918. Jun 10 04:36:55.257626 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:37:15.246339 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:37:16.371545 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:37:17.387801 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44932. Jun 10 04:37:19.157750 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:37:57.125291 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:37:58.141025 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44946. Jun 10 04:38:51.127716 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:38:52.148929 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab051156-0c60-4048-8c6f-9eb4a5a7141b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44954. Jun 10 04:38:55.154490 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:38:56.174531 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [47cec8a6-cdc8-41e7-8ede-e538229b93ff] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44958. Jun 10 04:39:01.328798 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:39:03.887132 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:39:28.139454 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:39:34.306702 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:39:35.323131 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee4ed7e9-2cca-4bb7-917b-2fabb31d51ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44970. Jun 10 04:39:40.441671 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:39:41.456985 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [bedb4f90-1b35-4c8e-9e89-9a7bfe88def3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44972. Jun 10 04:40:15.273713 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:40:17.388568 n-d-779913-11 nova-conductor[99294]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 04:40:18.403858 n-d-779913-11 nova-conductor[99294]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a7a3742-9ee9-4e77-85c8-d84703b430b5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44978. Jun 10 04:40:35.261829 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:40:39.176785 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 04:40:58.142255 n-d-779913-11 nova-conductor[99293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] AMQP server on 10.222.0.49:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 10 04:40:59.158146 n-d-779913-11 nova-conductor[99293]: INFO oslo.messaging._drivers.impl_rabbit [-] [5acc77b6-a539-449d-989b-aff4807ac803] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 45006.